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INTRODUCTION 


An engineer confronted with the problem of designing an autopilot 
system for a rocket vehicle whose ratio of length to diameter is moder- 
ate to high is faced with a host of new problems. These problems arise 
principally from the fact that rocket structures are usually highly flex- 
ible because of the requirement for a low ratio of structural weight to 
total vehicle weight (usually only 10 percent of the vehicle weight is 
made up of structure that can resist elastic deformation of the vehicle 
under the various forces to which it is exposed in flight). For such sys- 
tems, the control engineer can no longer concern himself only with the 
pitch, yaw, roll, and translation of the vehicle to obtain the requirements 
that his control system must satisfy, but rather he must broaden the 
scope of his analysis to include problems associated with the elastic 
structure, both to discover the control system requirements and to 
assure the compatibility of the control system with the dynamic charac- 
teristics of the elastic structure. Specifically, if he does not consider 
the effects of the elastic structure on the control system requirements, 
he may well design a system that will be unstable when actually installed 
in the vehicle; if he does not consider the compatibility of the control 
system with the dynamic characteristics of the elastic structure, he 
may design a stable control system that will cause structural failure 
because of dynamic elastic deformations arising from this operation. 

The above problems are not academic, but very real, and occur almost 
universally in rocket vehicle design. The basic reason for this is that 
the highly elastic heavy structure will usually have an elastic response 
mode whose frequency falls well within the control frequency band and 
cannot be neglected, in contrast to conventional aircraft design where 
the control band can usually be chosen well below the important elastic 
response frequency bands. 

One mathematical formulation of a problem within the framework 
outlined above was stated in the original procurement request, and is 
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in essence repeated here, paraphrased to conform to the particular 
problem considered. 

The steady-state missile dynamics are represented by a homo- 
geneous system of differential equations. 

x = Ax 


where x is an n-vector and A an nXn matrix, together with an initial 
state x(0) = x°. The system expresses various forces and torques due 
to structural and aerodynamic effects. The time interval 0 ^ t ^ T for 
the problem is assumed to be sufficiently short that A is considered 
constant. A scalar disturbance y is introduced to represent wind effects 
in the missile where, analytically, y ^ y(t) is restricted to a class of 
functions T. In order to maintain stability under a disturbance as des- 
cribed above, control elements are introduced into the system as a 
scalar ^ i n some class of functions T'. 

The system is now rewritten to include y and as 

x = Ax + ai{j + by , x(0) = x° 

where a and b are constant n-vectors. Let L^ be a given set of constants 

such that |x^| < L^, i = 1, 2, • • • n assures that the system remains stable. 

The basic control problem may now be posed as an optimum 

control one; that is, a control must be found that will ensurejx.j ^ Lr< L^ 

for all functions y in the class where Lj is the least such bound for 

each i. Since the control law which gives L^ may be different for each i, 

it may be necessary to specify constraints on L^. For example, if 

L' = cL where 0 < c < 1, the control law that minimizes c could be 
i i o. 

determined. Or the control law that minimizes L. only while satisfying 
| x^| < L^, i = 1* • • n could be found. 

The particular problem formulation for the present investigation 
is to find 4 1 that realizes 


min max ||x|| 
ed' y e r 
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Because of the difficulties inherent in this particular version of the 
minimax problem, a related formulation is used 


max min lim 
YeF i n-^co 


T 

J |x(t) * Qx(t)| n dt 


1/n 


where Q is a nXn positive semidefinite matrix. 

The rationale behind the modified form is discussed in Section 2, 
wherein the problem is specialized to determining 4 for 


min / [ x(t) • Qx(t)| n dt 

4** o 1 J 


(i) 


which is related to finding 4 for 


min J 

4 o 


CO / \ 


dt 


( 2 ) 


where 4 a positive semi-definite multinomial form. As a first ap- 
proximation to the minimax problem, criterion (1) is used with n = 1, 
resulting in a linear controller; the derivation of the design procedure 
for the linear approximation is presented in Section 3. Better approxi- 
mations are obtained using criterion (2); these are discussed in Section 4. 

The design procedure developed in Section 3 has been programmed 
for the IBM 7094; the programs are discussed in Section 5, as are the 
results of applying the design procedure to a five -dimensional model of 
the booster (taken to be two linked rigid bodies). The controllers thus 
designed were simulated on the IBM 7094; the results of the simulations 
are presented in Section 6. 

A more complete mathematical model, including the effects of 
body bending, sloshing, and sensor dynamics, is developed in Section 1. 
The 26-pole model derived is about as large as the capacity of the com- 
puter will allow without modification of the programs, and is also about 
as small as it could be to be a good representation of the physical 
system. 
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A recapitulation of the results of this investigation, along with 
suggestions for further study, is given in Section 7. In addition, several 
appendices are included for background material, for detailed deriva- 
tions, or because they were published as papers based on the material 
generated under this contract. 
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1. MATHEMATICAL MODEL 

In the analysis or synthesis of any physical system, one of the 
first and most important steps is the selection of an appropriate 
mathematical model. For initial synthesis and feasibility analysis, 
a rather gross approximation to the actual dynamics may suffice; for 
final analysis and simulation, a more faithful description is usually 
necessary. When the physical object is as complex as the non-rigid 
aeroballistic vehicle treated herein, the problem of choosing the model 
is especially difficult, not necessarily from the point of view of the 
dynamic description, but rather from that of determining how much 
fidelity is required to achieve a sufficiently accurate assessment of 
the behavior. 

The model derived in this section is intended to be complete 
enough for an accurate determination of the dynamics of the vehicle, 
and yet of a low enough order to allow computer simulation. Included 
in this model are: 

1) Aerodynamic forces (considered to be located at the vehicle 
center of pressure). 

2) Inertia reaction torques on vehicle motion due to nozzle 
dynamics ( n tail wags dog" effect). 

3) A flexible vehicle (bending modes). 

4) A liquid fuel (sloshing modes). 

5) Cross couplings of bending and sloshing modes with rigid 
body modes because of engine thrust. 

6) Couplings of bending and sloshing modes with engine 
dynamics. 

7) Sensor dynamics. 

Not included are the effects, of: 

1) A distributed aerodynamic force on vehicle motion. 

2) Flutter due to aerodynamic forces. (This is an aeroelastic 
phenomenon, to be accounted for during the airframe struc- 
ture design phase; it is not a control problem. ) 

3) Bending motion on aerodynamic forces. 
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The coordinate system definition and the definition of important physical 
constants are shown in Figure 1-1. The moving coordinate system is 
located with its origin at the eg of the booster, oriented as shown. If 
the vehicle were rigid and the nozzle undeflected, the x-axis and the 
center line would coincide; the z-axis is in the plane of the local vertical 
and the velocity vector, which is also assumed to be the plane of the 
deflected booster centerline. The angle w denotes the rotation of the 
center line due to a deflection of the nozzle in the absence of bending; 
in this case the center line is taken as the line through the centers of 
gravity of the vehicle minus nozzle and of the nozzle alone. 

EQUATIONS 

The first four equations, which describe the motion of the vehicle, 
may be obtained through the use of Figure 1-1, by summing forces and 
moments; Table 1-1 is a list of symbols. (Note that a, 4>, ^ , and P 
have been assumed small. ) 

Normal Force Equation . 

The normal force equation is found by summing forces in the 
direction normal to the missile's longitudinal axis (z direction) and 
equating it to the acceleration in that direction. 

Ma z = N^ a 4- Mg cos 0 0 + (N^ -D)w-Ti|j +T c P (1-1) 

Axial F orce 

The force along the longitudinal axis of the missile (the x direc- 
tion) is 

Ma = T + T - D - Mg cos 0 (1-2) 

x c 

External Moment Equation 

The moment equation is found by summing the moments about the 
center of gravity of the missile 

10 = N i a + Dv + N i w - (T + T )u + T I i|< - Tip (1-3) 

y a p a p ' c' g g^g c g 

The following kinematical equation will be useful; 
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a ( ) 

- 

acceleration in direction identified by subscript 

6 

a 

- 

angle of actuator deflection 

4> 

~ 

angle between reference trajectory and missile ! s longitudinal 
axis 

a 

- 

angle of attack 

a 

w 


crosswind acceleration 

p 


angle of nozzle deflection 


“ 

th 

normalized deflection of i bending mode 

L. 

1 

- 

tli 

normalized deflection of i sloshing mode 

g 

- 

acceleration of gravity 

N 

a 

- 

normal aerodynamic force per unit of angle of attack 

D 

- 

aerodynamic drag 

T 

- 

thrust of inactive engines 

T 

c 

- 

thrust of active engines 

V 

- 

nominal absolute velocity of missile (c. g. ) 

M 

- 

total mass of missile 

I 

- 

total moment of inertia of missile 

M n 

- 

mass of active engines 


- 

moment of inertia of active engines 

m . 

i 


th 

effective mass of fluid for i sloshing mode 

x. 

L 

- 

th 

effective location of mass of fluid for i sloshing mode 

^Si 

- 

damping ratio of 1 1 sloshing mode 

w c . 

Si 

- 

th 

natural frequency of i sloshing mode 

^Bi 

- 

damping ratio of i^ bending mode 

w Bi 

- 

th 

natural frequency of i bending mode 


Table 1-1. Nomenclature. 
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n 


g 


B 


n 


K 


n 


K 


F. 


th 

normalized slope of i bending mode at location identified by 
subsc ript 

th 

normalized deflection of i bending mode at location identified 
by subscript 

distance between center of mass of engine and the gimbal point 
(positive for gimbal point forward of center of mass) 

distance between center of mass of missile and the nozzle 
gimbal point (positive for gimbal point aft of center of mass) 

distance between center of mass of missile and center of 
pressure (positive for c.p. forward of c.g.) 

friction damping factor for nozzle travel 

effective spring constant between nozzle and case 

effective spring constant of actuator arm 

angle between local vertical and reference trajectory 

/ (r.) 2 d m = m. (r.) 2 

m. l' 11 

where: is the radius of gyration of the sloshing fluid. The 

integration is taken over the effective mass of the sloshing 
fluid (m.). 

z-axis intercept of the center line of rigid body with nozzle 
deflected 


- rotation of center line of rigid booster due to nozzle deflection 

- static sensitivity of actuator 

- actuator time constant 

- actuator natural frequency 

- actuator damping ratio 


Table 1-1. Nomenclature (continued). 




Normal Acceleration 


The vehicle acceleration in the z direction is given by: 

a = -Vat - a at 4- V0 + Va (1-4) 

z x w 

The remaining equations require some explanation of the repre- 
sentation used for the bending and sloshing dynamics. Both effects re- 
sult from the motion of continuous media, and the fundamental dynamical 
equations. Application of the technique of separation of variables to 
these partial differential equations results in an infinite sequence of sets 
of total differential equations for each. Each set in the sequence consists 
of differential equations in spatial coordinates and a differential equation 
in time; the solution to such a set is called a mode. For a detailed dis- 
cussion, see the references. The resulting time equations are: 

Body Bending Equation 

The bending equations are found by applying Hamilton 1 s principle, 
th 

This yields for, the k bending mode, 


M q . + 2 1, 


Bk Bk M k 


<03k> 


- M (a + g cos 0) X 


x 


kg 


- T0. ib - (2 F . X . ) (w + 4>) + 2 2 F . X . X 

^kg ^g V i kx.' v . . i kx. 


q. 

JX i 



m , 




+ k k g ) ( a x + g c °s 0) 



(1-5) 


-(M f 0. + I X, ) (3 - T 0,(3 

' n n kg n kg c kg K 


Fluid Sloshing Equations 

The sloshing equations are obtained by the same method as the 

th 

bending equations. This method yields for, the k sloshing mode. 
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( 1 - 6 ) 


^k + 2 ^Sk“Sk^k + <“sk' 2 + (a x + g cos 9) w + x k w + V - 

- V« - * k 0 + S (a x + g cos 6) k 4 q, - * ix 4 = 0 

1 K K 

The spatial equations may be solved to determine the positions and 
slopes necessary to solve (1-5) and (1-6); or, more likely, they may be 
found experimentally. 

Figure 1-1 plus the quantities entering into (1-5) and (1-6) lead to 
the following geometrical equations: 

Center Line Deflection 

The deflection of the vehicle center line (displacement of c. g. ) due 
to nozzle deflection and sloshing fluid is given by 

Mv = M i (3 - 2m. r. (1-7) 

n n r j j b j 


Center Line Rotation 

The rotation of the vehicle center line due to nozzle deflection 
and sloshing fluid is 


Iw = - (I + M l l ) (3 - 2 m. x. L. + 2 2 \ . F. q. (1-8) 

n n n g' K J J j j jx. i 

Engine Gimbal Point Deflection 

The deflection of the engine gimbal point from the undeflected 
center line of vehicle is given by 


u 


v - I w +20 q. 

§ i ig 


Engine Gimbal Point Slope 

The slope at the engine gimbal point is 


(1-9) 




w - 2 X. . q . 

i l « 1 


( 1 - 10 ) 


1-7 


There is one final dynamic equation: 


En gine Dynamics 

The engine dynamics are found by summing the moments about 
the engine gimbal point. This yields 


I P 

n 


B (3 
n 


(K + 
n 


K ) (3 - M 
a' r n 


: a 

n z 


+ (I + 

n 


M i 
n m 


v* 


+ ^ n gcos00+M (a x + g cos 0) v - I n iji - (a x + g cos 

-M i u - Z (a + ecos0)m.C. = K 3 ( 

ii u g ■ x J J a a 


After elimination of the intermediate variables of v, w, u^, 
and 4* by direct substitution, Equations 1-1 through 1-11 reduce to 
Equations 1-12 through 1 - 1 6 (the coefficients Y are listed in Table 1- 

Normal Force Equation 


« + Yi a - 0 + Y Z <P + SlY^) + zWq &:) = Y 5 P + a w 

■i i J 


Moment Equation: 


4>+ V 6 « + 2 (Y^ q 4 ) + 2 <Y J g U = Yq P 

i j 


Nozzle Dynamics Equation: 


Y 10 0 + Y n « + 2 (y\ 2 q\) + 2 (y\ 3 q t ) + 2 (y^ tj) 
i i j 

+ 2 <v j 15 q) + Y l6 P = V 19 P a 

j J 


e) *g 

L - 1 1) 


2 ). 

( 1 - 12 ) 


( 1 - 13 ) 


( 1 - 14 ) 


1-8 





Bending Deflection Equation (k^ 1 mode): 




(1-15) 


( 1 - 16 ) 


In addition to the equations of motion, it is necessary to introduce 
equations that describe the output of any sensors used. Sensors 
mounted on the vehicle sense the rigid body motion, the motion of 
the vehicle arising from the bending modes, the sloshing modes and the 
engine dynamics. The following three equations show the total inputs 
to the various sensors. It should be noted that these equations apply 
only to "perfect 11 sensors. No sensor dynamics have been included. 

The addition of sensor dynamics requires the cascading of the sensor 
dynamics with the output of the "perfect” sensor defined by Equations 
1- 17, 1- 18, and 1- 19. 

Angular Displacement 

The angular displacement sensed by an instrument located at sta- 
tion P along the missile 1 s longitudinal axis is given by 
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Rate 


The input to an angular rate sensing instrument located at station 
P along the missile's longitudinal axis is given by 



( 1 - 18 ) 


Normal Acceleration 

The input to an accelerometer which senses acceleration normal 
to the longitudinal axis of missile located at station A is given by 



( 1 - 19 ) 


The equations governing the sensor dynamics depend upon the 
mechanization of the sensor; the following are typical sensor dynamics: 

Angular Displacement 

If it is assumed that the angular orientation is measured by a 
position gyro, the sensor dynamics can be taken as a pure gain. The 
attitude reference is a "free" gyro (really a three-axes gimballed gyro), 
and the orientation of the body relative to the gyro is read out by means 
of synchro pickoffs. Any dynamics associated with the motion of the 
gyro would arise as a result of manufacturing inperfections, e. g. , 
bearing torques and mass unbalance. The synchro is essentially a vari- 
able transformer; the dynamics associated with the synchro signal arise 
in the signal processing circuitry and are quite high in frequency. 
Synchro pickoffs, or analogous linear devices can be used to measure 
engine gimbal angles. 
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Table 1-2. Coefficient definitions . 
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I 
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Table 1-2. Coefficient definitions . (continued) 


Angular Rate 

Vehicle angular rates are usually measured by single-axis spring- 
restrained gyroscopes (rate gyros) which exhibit damped oscillatory 
behavior (second order). Accelerations about the axis perpendicular to 
the spin axis and the sensitive axis appear as rate errors, as do cross- 
coupling effects at large rates. The engine gimbal rates can be meas- 
ured with a tachometer with negligible dynamics. 

Normal Acceleration 

Normal acceleration is also usually sensed by devices exhibiting 
second order behavior, e. g. , damped spring-mass linear accelerometers 
and integrating-gyr o accelerometers. 



Actuator Dynamics 


If the signal from the controller is used to displace the control 
valve of a hydraulic actuator, the transfer function between the control 
signal and the actuator displacement may be taken to be of the form 


(r 


s 




( 1 - 20 ) 


Model Dynamics 

Before the model is completely specified, the number of bending 
modes and sloshing modes to be included must be determined. Since 
the natural frequencies of the dynamics increase as the mode number 
increases, the number of modes is usually determined by neglecting 
those modes corresponding to natural frequencies "sufficiently high" in 
comparison with the control system response characteristics. For the 
nonrigid aeroballistic booster studied herein, four bending modes and 
three sloshing modes were retained, resulting in a 26-pole transfer 
function (or 26 state variables). A descriptive block diagram of this 
model is shown in Figure 1-2. The summation points should be inter- 
preted as indicating that the given input affects the block in question, 
but not necessarily in the strictly additive manner shown. 
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2. MINIMAX PERFORMANCE CRITERIA 


In the original proposal to MSFC, Hughes Aircraft Company- 
defined a class of performance criteria which were to be investigated 
to determine their usefulness for generating control laws. These 
criteria are designated "minimax" and pertain to the keeping of speci- 
fied combinations of states of the given system as small as possible 
when the system is acted upon by the "worst" of a class of external 
disturbances. This class of performance criteria can be better 
described in a mathematical form. 

Let the system under consideration be governed by 

« 

x = Ax + ai^ 4- by 

where 

A is an nXn plant matrix 

a is an n-vector, coupling the control into the system 
b is an n-vector, coupling the disturbance into the system 
is the scalar control to be chosen 
y is the disturbance. 

Let Y = Y (t) be a member of the set of allowable disturbances T, denoted 
by ye r ; similarly let ^ (x) e T' , the allowable set of controls. Then 

one form of minimax criterion is given by the following 

min max || x II , 

Ijjcvfr Y* r 

where a variety of norms may be used for || * || . One convenient norm is 

II x || 4 max || x(t)[| 

" 11 t e[o, T ] ' Q 

where 

II x(t)|| Q ^ x(t)- Qx(t) 

with 

Q = Q* - nXn positive semi-definite matrix. 


2-1 


Using these definitions and the fact that 


|f(t)| = lim 

[ r T i 

J j f (t) | n dt 

n — co 

[ o 


te [o,T ] 

we can write this minimax criterion as 

.T 


1/n 


min max lim 

yeT n— ►oo 


/ [x(t)* Qx(t)f dt 


1/n 


Another version of minim ax criterion results when one interchanges 

max and min , Doing this we may write 
y € F ijj 


max min lim 
y € T ijj 6 n — ► co 

This form is mathematically more tractable than the previous one and is 
the one which Hughes Aircraft Company studied extensively during the 
past year. It should be emphasized that, in general, one does not get 
the same value for the performances indices in the two cases. The exact 
conditions under which such an operation yields the same numerical 
results before and after the exchange is not known. This is a current 
area of research both at Hughes Aircraft Company and many other insti- 
tutions. In what follows we shall only concern ourselves with perform- 
ance criterion 


f [x(t)- Qx(t)] n dt 


max min lim 
y € T 4^^ n — ' ^ co 

Specifically first consider 


min lim 

iJjeM/ n — go 

This in itself is a difficult mathematical problem and must be further 
simplified before a meaningful solution can be presented. With this in 


J [x(t)- Qx(t)] n dt 


J [x(t)- Qx(t)] n dt 

o 
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mind we propose studying the minimization of 


J [x(t)-Qx(t)] n dt 
o 


1/n 


for some large fixed integer n , instead of minimizing 


lim 
n — ® 




Again rigorous justification of the closeness of these two problems 
is difficult, but the results of simulations have shown the simplification 
to be valid. The actual problem considered is 


min 


J [x(t)- Qx(t)] n dt 


1/n 


The first approximation to be considered is the case when n= 1. 
This is described in Section 3 and the neces sary background is given in 
Appendix C. For the case n = 1 an exact solution may be found, but in 
the case n >1 only an approximate solution is easily obtained. 

In Section 4 minimization of performance criteria of the form 



hv (x) + 


i^ 2 + i 



dt 


where 4 j^ v ( x ) is a positive semi-definite multinomial form, is described. 
It should be noted that the pe rformance criteria 


J [x(t)-Qx(t)] n dt 
o 

can be put in this form by letting iji (x) = (x-Qx) n and ip (x) = 0 

£n £ v 

when v ^ n. 
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Thus the problems considered there are of a more general nature 
than minimization of 


J [x(t)-Qx(t)f dt 

o 
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3. LINEAR DESIGN PROCEDURE FOR MINIMAX PROBLEM 


Using the standard techniques of control system analysis and 
design such as root locus, Bode analysis, etc. , for high order systems 
usually results in a great deal of successive approximation and often 
depends heavily on the ingenuity of the particular investigator carrying 
out the analysis. Indeed, the concept of optimum design is not even 
considered in general, for the very nature of the methods used necessi- 
tates individual attention for each problem. These difficulties, coupled 
with the fact that the "clas sical" methods have no natural extension to 
systems with time-varying parameters and nonlinearities, have led 
modern contributors in control theory to consider the problem from a 
fresh viewpoint - that of state space analysis. The advantages of this 
approach are manifold. Involved and often very specialized computa- 
tions are reduced to common matrix manipulations quite amenable to 
present day high speed computing devices. The idea of optimal design 
can be stated in a very simple manner which is applicable to a myriad 
of problems. Physical variables are not lost in a jungle of mathematical 
manipulation, but rather maintain their identity throughout the analysis 
of a problem, thus permitting new insight into the role of these variables 
in the overall design. Perhaps the most important single advantage of 
state analysis is that there is no conceptual difference in the presentation 
of linear, linear time -varying, or nonlinear problems. All this has 
inspired a vast amount of research which, in turn, has resulted in a 
flood of publications in the area. In their zeal to contribute, many writers 
have overlooked completeness in favor of broadness, and even though 
many complex problems have been considered, efficient engineering 
solutions to many important control problems are lacking. Although the 
work of R. E. Kalman is nearly definitive from a mathematical view- 
point, it neglects the design problem from the point of view of the prac- 
ticing control engineer. Because of his determination to solve the auton- 
omous and nonautonomous optimal control problems simultaneously, 
Kalman failed to attain ultimate simplicity in the solution of the former 
problem. Thus his theory for constant coefficient systems depends on 
the steady- state solution of a matrix differential equation, a numerically 
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cumbersome proposition. Work at Hughes, on the other hand, as pre- 
sented in the paper, "High Order System Design Via State Space Consid- 
erations, has permitted the design of optimal single channel controls 
by purely algebraic means , thus reducing computer time and allowing 
for extension to high order systems. The following discussion is based 
primarily on that paper. 

In general, a linear system with single channel control can be 
represented by the set of differential equations 


x = Ax + aijj 


(3-1) 




Hi i-V^ 1/ ^ A. O , 


"where x is the state vector, A is the matrix of the plant pcir amu ° > 
a is an actuator vector, and i s a, scalar control function, assumed here 
to be a linear combination of the states at any instant of time. The object 
of the design procedure under consideration is to find this linear feedback 
relationship so as to optimize the performance of the resulting "closed 
loop" system. In particular, the elements of a vector g are sought such 
that 4 1 = g * x minimizes an integral of the form 

as = — / fx-Cx 4- Uj )dt (3-2) 


i r 2 

= (x-Cx + ^ )dt 


where C is a symmetric non-negative definite matrix. The choice of 
the matrix C is equivalent to specifying the nature of the optimality to 
be considered. Indeed, it directly determines the performance of the 
resulting system. This matrix can be appropriately chosen only in the 
context of a particular problem. For aerospace vehicle stabilization, 
quantities such as structural load, pitch error, etc. , must be kept below 
certain bounds while the maximum of some critical quantity such as 
lateral drift is minimized. Indeed, load, pitch error, and drift can be 
expressed as a linear combination of state variables of the form 


i 

q - x 


i = 1,2, 


By noting that in the integral 


J [(q 1 * x)/k q 2 dt 


the total contribution of time at which Jq 1 • x| > k q holds is "penalized 1 
disproportionately compared to the times at which (q 1 * x| < k q holds, 
'^Presented at 1965 JACC. 
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the matrix C can be specified. In particular, the abovementioned 

objectives are satisfied to a first approximation if 

2 

lq ) +•••+(... 

m 


C = Kjq^q 1 )' + K 2 q 2 (q 2 )' +••• + K r 


m. m, 

,q (q ) 


(3-5) 


In the analysis of systems by state space approaches, the concepts 
of controllability and observability lie at the very foundation of system 
theory. Mathematically, if controllability is ensured, there always 
exists some control to bring the system from one arbitrary point in 
state space to any other. If an output is observable, that output cannot 
vanish identically for a finite period of time unless the system is totally 
at rest. (See Appendix F for mathematical criterion for linear systems. ) 
Heuristically, the lack of controllability implies an "open circuit" some- 
where in the system input (i. e. , one or more modes of the system can- 
not be reached). Analogously, if an output is not observable, then an 
'open circuit" exists in that output path. These ideas do not appear in 
the classical transfer function methods, for the transfer function itself 
is only a valid representation of the observable and controllable part of 
a linear dynamic system. Appropriate tests for these criteria can be 
made only when the system is represented in the "natural" form of 
simultaneous differential equations in many variables. 

The theoretical development of the actual design method in ques- 
tion is fairly involved and so only an outline of the ideas will be dis- 
cussed here. Basically, Pontriagin's Maximum Principle is applied to 
the system (3-1) to give the necessary conditions for minimizing the 
integral (3-2). Combining the resulting equations with stability require- 
ments as formulated by Liapunov's Second Method results in a unique 
feedback law which can always be found by purely algebraic operations. 

In particular, the design method suggested is based on finding the re- 
solvent of the matrix A (evaluating the matrix of polynomials in s given 
by |sl - aJ * ). This can be accomplished directly by Leverrier's 
algorithm or indirectly by standardmatrixmanipulations. In finding the 
resolvent, the characteristic equation for the system is also explicitly 
displayed. From these quantities, and the chosen performance matrix 
C, the characteristic equation for the optimal closed loop system can 
be directly determined. Then, with the aid of a specially derived 
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relationship between the open and closed looped systems the vector g 
can be found. It is to be noted that thus far system c ontrollability has 
been assumed. The "amount" of controllability as given by a specific 
algebraic criterion determines the magnitude of the vector g and hence 
the feasibility of practical implementation of linear control. 

In addition to being optimal in the sense discussed previously, 
systems designed by these methods are remarkably adaptive to large 
variations or to saturations in both feedback signals and actuator 
characteristics. It is shown in Appendix C that once a system is de- 


qiornprl r>n-i ni Xlliz 0 3. CUCldr CL txC uc 
o ----- -» 

can be found which will guarantee 


rforrnance inde-^, a Liapunov function 
the stability of the system to certain 


initial perturbations for considerable variations in the feedback signal. 


Furthermore, under these conditions the modified performance index 


f°° 

l/Z J |x • Cx + (g ♦ x) dt (3-6) 

will not be increased beyond the nominal minimum value found for the 
system if no perturbations were present. Adaptivity to feedback satu- 
ration is particularly important when the elements of the control vector 
g are relatively large. 

In a wide class of problems, saturation may not be permissible 
or it maybe very desirable to keep the magnitude of the control vector 
small. This can be readily accomplished by taking the matrix C in (3-2) 
to be identically zero. Minimizing the resulting performance criterion 
will then be equivalent to minimizing the "amount" of feedback m a 
least-squares sense. With a stable plant this so called "minimum 
effort" control reduces trivially to no control at all. However, with an 
unstable plant such a criterion generates a closed loop system whose 
poles consist of the stable plant poles and the reflections in the imag- 
inary axis of the unstable ones. In this case then, the optimal control 
law can be tested easily and compared with other criteria. 

In the design of large aeroballistic launch vehicles there are 
situations in which linear feedback can yield an exact answer to the 
minimax control problem. This occurs when an arbitrary linear 
combination of state variables can be forced to decay directly from an 
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initial perturbation. The necessary and sufficient conditions for the 
existence of such an "ultraminimax" control are shown in Appendix G 
along with an explicit formula for that control when it exists. It is 
also shown there that ultraminimax control is a limiting case minimizing 
a criterion of the form (3-2) when the terms in the state variables are 
increasingly weighted in comparison to the control term. 

It is to be emphasized that designs discussed up to this point are 
really incomplete, for they assume measurement and feedback of all 
state variables — a highly unlikely situation in common problems. To 
supplement these methods, a filter has been designed which can approxi- 
mately generate g-x given only incomplete state information. That is, 
the output of linear sensors measuring independent observable variables 
can be used to generate the optimal feedback control. The filter con- 
figuration in general consists of parallel networks, each operating on 
a specific sensor output. These networks have common poles which are 
completely arbitrary. The number of poles needed in the filter is usually 
equal to, or slightly greater than, the quantity n/m - 1, but less than 
the quantity n - m when n is the order of the given system and m is 
the number of independent sensor outputs. It is found that the optimal 
system poles as determined above are mechanized in the closed loop 
system when the filter is introduced. Furthermore, as the real parts 
of the chosen filter poles become more and more negative, the corre- 
sponding poles of the overall closed loop system approach more and 
more closely the chosen poles themselves. It is noted that this method 
of filter design may be limited because of increased sensitivity to sensor 
noise and system parameter variations when fast poles are introduced. 
The important problem of supplementing this design with a method for 
optimizing filter pole locations in accordance with a minimal variance 
scheme has not yet been considered and is an open research problem. 

One possibility would be to estimate all state variables via a Kalman 
filter and then reconstruct g- x . This, however, always introduces 
n new poles to the system. For high order systems, a Kalman filter 
can be quite cumbersome and expensive. As an approximation, perhaps 
the dominant poles of the Kalman filter can be used in optimizing the 
poles of the parallel filter described above. Additional research is 
needed to determine the feasibility of this proposition. 
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4. DESIGN PROCEDURE FOR NONLINEAR APPROXIMATION 

OF MINIMAX PROBLEM 


The problem of minimizing a quadratic performance criterion 
for a linear time -invariant plant subject to a mean square constraint 
on the cost of control leads to a linear control law. As a natural 
generalization of this problem, the problem of minimizing a quartic or 
higher order performance criterion subject to a mean- square constraint 
on the control maybe considered. The theoretical details of the solu- 
tion to this problem are presented in Appendix E. In it, the known fact 
that it is necessary to introduce quadratic terms in the performance 
criterion to ensure stability of the overall system is reviewed. Then 
the quartic and higher-order terms are introduced in order to impose 
bounds on specified state variables. In other words, the linear control 
derived from the quadratic terms stabilizes, and the cubic or higher- 
order control derived from the quartic or higher-order terms limits, 
the transient response to the desired region. This is exactly what might 
be suspected, since the stability of a nonlinear autonomous system in 
a neighborhood of the origin is determined by the linear terms. The 
nonlinear control law is derived by finding the unique solution to the 
Hamilton- Jacobi partial-differential equation for the problem posed. 

As shown in Section 2, performance indices of the form 


nrw 


hv< x > 


i * 2 


+ — 

2 nf 


dt 


v=l L 


(4-1) 


where ^^(x) is a 2v order positive s emi definite form, 4* is the control 
to be chosen, and 4* n | is the nonlinear portion of the control, arise 
quite naturally as approximations to a minimax performance index. 

This performance index may be interpreted in an alternate 
manner; namely, minimize 





dt 


(4-2) 
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subject to 



dt < P 


(4-2b) 


and 



dt ~ P 2 


(4 -2b) 


By the use of Lagrange multipliers, one can change (4-2) to (4-1). This 
is explained in detail in Appendix E. 

During the past year, Hughes has studied (4-1) in detail to 
dtermine an optimal control law which will lead to a minimax type of 
response for the closed loop system. A concise statement of the prob- 
lem, as well as the synthesis procedure used, follows below. Minimize 
the performance index $ 



4 b( T [ 1 (^) + 1 1 " 2 + i '"nf dt 

(4-3a) 

where 

+ 2i/ (x) >0, X 4 0 

(4-3b) 

and 

4, 2v (px) = P 2U ^ 2 v (x) 

(4-3c) 

subject to 

x = Ax + a4 

(4-3d) 


tVi 

The 4^ (x) are the given 2^ order forms and *4 is to be found. 


The control law 


4; (x) = - a*grad^.j V(x) 


where 


V (x) = 


/I 



(X): 


> = 1 


(4-4a) 

(4-4b) 


is the optimal control law for (4-3). 
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The expressions 4> 2v (x) must related to the given expressions 
^ 2i/ (x) in order to complete the solution. This relationship is separated 
into two parts characterized by v = 1 and v > 1. Considering the case 
v = 1 and introducing the notation 

4> 2 (x)=x-Cx (4- 5a) 


and 


| 4> 2 (x)=x. Bx (4 -5b) 

| it is necessary that B satisfy the equation 

\ 

\ A'"B + BA - Baa B = -C (4-6) 

i 

j For the case v > 1, it is necessary that the ^^(x) satisfy the equations 


where 


Ax • grad (x) <t> 2v (x) = -+ 2v (x) 


A = A - aa v B 


(4- 7a) 


(4-7b) 


Here A corresponds to the stabilized linear portion of the system. With the 
above relationships, the following holds for the optimal closed loop system. 
-Tl 


./ 




* 


Zv 


L 1 .2 , 1 ,2 

+ 2 ^ + 2 * 


n; 


v=l 


dt= 2 (^^Zv (x0) (4 " 8) 


V ~ 1 


Note that there is equality in equation 4-8 and the right hand side is 
identical to the Liapunov function V(xO) chosen for the closed loop 
system. Thus V(x°) is the unique solution to the Hamilton- Jacobi 
equation for the problem stated. Optimal control laws found by this 
procedure may actually saturate when mechanized. The resulting 
system may become unstable for a large initial condition because of the 
"limited amount" of control available. Estimates for the allowable 
range of initial conditions in such a situation are derived for the linear 
case in Appendix C and for the nonlinear case in Appendix E. 

These estimates determine the domain of asymptotic stability of 
the resulting system. However, when disturbances are coupled into 
the system, one is faced with a problem of determining the region which 
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bounds the system motion when acted upon by persistent disturbances. 
Thus it is necessary to find a suitable Liapunov type function for the 
nonautonomous disturbed system. (This is called "practical stability" 
by Lasalle and Lefschetz. ) Some results have been obtained in this 
area so far and there is considerable evidence that further results are 
po ssible. 

It should be mentioned that this problem of determining the 
"operating" region of a disturbed system results from the fact that the 
optimal control law was found for an undisturbed system with an initial 
condition. However, results of Potter and Tung seem to indicate that 
a system designed on this basis will be the best system when the actual 
disturbance is white noise. 

To gain some insight into the problem of determining the domain 
of stability of the disturbed system consider Figure 4-1. 




Figure 4- 1 . 

Figure 4- la depicts the motions of the undisturbed system for two 
initial conditions Xg^ and Xg^. When the system motion starts in the 
region IRg, as is the case for the initial condition Xg^, it eventually 
returns to the origin. Thus IRg represents the domain of asymptotic 
stability. It should be remarked that IRg is bounded when the control 
is bounded. Theorem 2 of Appendix E characterizes the region IRq. 

Figure 4- lb represents the type of motion that would be 
expected for a disturbed system when the magnitude of the disturbance 
is bounded. Any initial condition Xg^elR^ -IR^ leads to a motion which 
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eventually enters IR 1 and remains there. Any initial condition x Q2 
outside of Rq leads to motion which is unstable because of the assumed 
boundedness of the available control. Determining the regions IR ^ and 
IR 0 of Figure 4- lb would allow the designer to assess accurate bounds 
on motion of the controlled system. This is an area of study which can 
yield valuable results for designing minimax control systems. 
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5. COMPUTER PROGRAM FOR LINEAR DESIGN PROCEDURE 


BACKGROUND 

In this section, the paper entitled "High Order System Design 
via State-Space Considerations" is mechanized by two basic digital 
computer programs, including several special subroutines. Included 
are the listings of the routines, associated diagrams, and a complete 
dictionary of symbols. The actual IBM 7094 printout of a case using 
a fifth order Saturn model is given. 

The digital programs are referred to by their Fortran language 
names, CNTRL2 and FILTER. Following is a brief description of their 
functions: Given the system matrix A, the actuator vector, a, and de- 

sired performance index matrix, C, CNTRL2 computes the optimal 
closed loop poles, then computes the corresponding control vector, g. 
FILTER, using data from CNTRL2, computes the parameters of a 
simple multiport filter to approximate the desired result. Another pro- 
gram, CNTRL1, was written which would compute the control vector to 
achieve arbitrarily specified closed loop poles. This program has been 
dropped, since the same result could easily be gained by reading in the 
arbitrary poles as data and bypassing the optimal pole computing por- 
tion of CNTRL2. 

Several subroutines were written to be called by one or both of 
the main programs. ALPHAS uses double precision arithmetic in the 
Leverrier algorithm to compute the coefficients of the characteristic 
equation of the system matrix. It is used twice in CNTRL2, first to 
compute the open loop coefficients, then to compute the closed loop 
coefficients as a check on the main program. POLYWG determines the 
optimal closed loop poles to be obtained by CNTRL2. SYNTH1 performs 
most of the vector and matrix manipulations of CNTRL2 to arrive at the 
control vector, g. OBSMAT computes the observability matrix and fil- 
ter arrangement matrix for FILTER. Three minor subroutines were 
written and used by several other routines. MATMPY multiplies 
matrices, DMATMP does the same in double precision. ORDINV re- 
verses the order of a one -dimensional array, useful since the library 
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subroutines use data which is in reverse order to that required for 
clarity in these programs. 

The programs are completely self-checking, with the exception 
of POLYWG. To check the validity of POLYWG, an arbitrary example 
was computed by the use of the Leverrier algorithm, which is itself 
self-checking. Enough confidence in POLYWG has been developed so 
that the possible incorporation of the Leverrier algorithm as a check 
on POLYWG (mentioned in an earlier report) has not been carried out. 

Four library subroutines available at Hughes were incorporated 
into the routines. Their functions are described briefly in this section. 
No details seem necessary, because anyone outside of Hughes Aircraft 
wishing to make use of the Linear Design Procedure would have to sub- 
stitute other subroutines which are at his disposal. 

An effort was made to make the programs as self-explanatory as 
possible, with the aid of many comments in the listings, accompanying 
block diagrams, a complete dictionary, and annotated comments on the 
printed output. Hence the explanations in the next section are not all 
complete in themselves, but serve merely to clarify a few details. 

PROGRAM DETAILS 

CNTRL2 

By having two performance matrices available, it is possible to 
vary the emphasis on different requirements by varying two weighting 
factors. In this case, the first performance matrix, Cl, was computed 
to minimize drift, and the second, C2, was computed to minimize load. 

A value of either 1 or 2 for MPRNTS must be read in as data, 

according to whether or not it is desired to write the S-matrices during 

the program. They should be written if the system transfer functions 

are desired. If MPRNTS = 2, ENORM, the sum of the absolute values 

of the S elements, is written instead. This is a sufficient indication of 
o 

roundoff error and takes much less space. 

Although the calling statement for ALPHAS contains ELINV in the 
argument both times, there is no meaning in the second call. ELINV 
is used only because it is no longer used by the program, hence is a 
convenient matrix to fill a space. 
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The coefficients of the optimal closed loop characteristic equa- 
tion (ALFOPT), as determined by POLYWG, are in inverse order — 
the standard order of the coefficients being assumed the order of powers 
of s to which they correspond. The order is reversed and the new array 
is called OPTALF. 

FILTER 

The input of the sensor matrix is arranged so that various num- 
bers of sensors can be tried without rewriting the program. Each card 
of a set of five represents a sensor. A blank or zero card indicates no 
sensor. The order of the sensors is not important, since the program 
eliminates the zero rows and labels the remaining ones as Sensor No. 1, 
Sensor No. 2, etc. The filter numerators are correspondingly numbered. 

The program specifies that N values (complex) be read in for 
POLES (I). These are the arbitrarily chosen filter poles. They should 
be in order of their desirability, since the program, after determining 
how many filter poles are required, takes as many as it needs, begin- 
ning from the top of the list. Actually no more than n - 1 could be used 
under any circumstance, so that the n th space could be left blank. 

The matrix VK is substituted for OBSERV in order to save OBSERV, 
since the library subroutine MATS destroys input information. 

The GAMMA matrix is obtained by separating the parts of the n- 
vector d and placing them in adjoining columns as shown in the defini- 
tions following Equation (31). ' This is done with the aid of the IJDLTL 
(filter arrangement) matrix which is described further under OBSMAT. 

There may seem to be some confusion concerning the H and HSTAR 
matrices. Note that they share storage locations by means of the 
EQUIVALENCE statement. Originally read in as HSTAR in order to 
represent each sensor by a single data card, the rows and columns are 
then interchanged to be used in computations. When HSTAR is written 
after the transposition, it is done by writing H but reversing the indices 
in the WRITE statement. 

*A11 equation numbers in this section are those of the equations in 
Appendix C, "High Order Design via State-Space Considerations. " 
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Sub r outine ALPHAS 


ALPHAS mechanizes the recursive relationship expressed by 
Equations (7a) and (7b). 

The single-precision inputs are replaced by double-precision 
variables. The computations are performed in double precision and the 
results are replaced by single precision variables for writing or storage. 
The double-precision dummies are dimensioned internal to the subroutine. 

INDEX(NN) is carried along only as a convenience in printout of 
the ALPHA'S and S-matrices. It allows the index to vary from 0 to N, 
not allowed directly. This feature is probably more confusing than 
necessary. 

Subroutine POLYWG 

2 2n , 

The coefficient of each even power of s from s through s oi 
the polynomial A^ n (s) is computed in turn. Coefficients of the odd terms 
are zero. Beginning with the working dummy COEFF(I) set equal to 
zero, the subroutine adds on the various parts as expressed in Equation 
(57). The index is then increased and COEFF(I+ 1) is computed, etc. 
Special cases (s° and s 2n ) are computed separately afterward. 

Signs of the various terms are determined by the variables SIGNI 
or SIGNJ which are, at the proper times, either +1 or -1 . 

The intermediate result is an n order polynomial in s . The 
n roots of that polynomial are determined by a root-finding routine. The 
complex square root of each root in s is taken, giving the 2n roots, 
half of which are in the left half plane. The complex square root function, 
CSQRT, provides only one of each complex pair. POLYWG accepts 
those which are in the left half plane, and changes the sign on those which 
are not. The resulting roots are the desired optimal roots. 

An effort has been made to make the Fortran symbols correspond 
very closely with the Equations (44) and (57). 

Subroutine SYNTH1 

Equations (14), (15b) and (20) are mechanized by this subroutine. 
SYNTH1 first computes the transpose of the controllability matrix, DSTAR 
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If it is singular, the control vector cannot be computed so the subroutine 
writes "System not controllable • • • " . Otherwise GLTL is computed 
and the subroutine makes a normal return to the main program, CNTRL2. 

Note that the equivalence statement is merely a comment, indi- 
cating that the actual equivalence statement must appear in the main 
program. AAT and BLTL, EN and AB are equivalenced as required 
by library subroutines. 

In order to preserve DSTAR for writing in the main program, 
another matrix, AAT, is substituted to make use of the simultaneous 
equation subroutine SIMEQ. 

Subroutine OBSMAT 

This subroutine follows the procedure outlined on page 4 of the 
reference to compute the observability matrix K (OBSERV). IJDLTL, 
the filter arrangement matrix, is constructed during the testing of 
columns for independence. Elements are made 1 if the column is inde- 
pendent, or zero if it is not. After FILTER computes d, the successive 
components will be placed columnwise in the elements of GAMMA if 
the corresponding elements IJDLTL are 1 . Elements of GAMMA are 
made zero if the corresponding element of IJDLTL is zero. The dimen- 
sions of the GAMMA and IJDLTL matrices are identical. 

For computational purposes, a slight refinement has been made 
on the Gram-Schmidt orthogonalization procedure. Normally, each new 
column to be adjoined is tested for independence by formation of the 
orthogonal vector W(I) . The column is independent if W(I) is not zero. 

In OBSMAT a tolerance has been introduced. The magnitude of 
W (WMAG) is required to be less than 10“^ times the average magnitude 
of previous columns (VMAVM6). 

Library Subroutines 

A brief functional description of library subroutines used in the 
Automatic Design Procedure which are available on tape at Hughes 
Aircraft Company follows. 
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MATS. 


Solves simultaneous equations in the form 


(A) (X) = (B) . 

(A) and (B) must first be adjoined into an n by n + 1 matrix (A 1 ) = (a|b). 
The solution vector (X) is dimensioned separately. The input matrix 
(A 1 ) is destroyed during computation. 

SIMEQ. Similar to MATS except (A) is not adjoined to (B) prior to 
use. Both (A) and (B) are destroyed during computation, with the solu- 
tion vector (X) remaining as the first column of (A). For this reason 
(X) must appear equivalenced to (A). 

ROOT1. A root-finding routine usually good to N = 20. N + 1 coeffi- 
cients of a polynomial in s are input, in order of descending powers of 
s. As an aid to the subroutine, an initial guess of the roots (APPROX) 
is made. If the initial guess is zero, the subroutine makes its own 
first guess . 

POLCO. Given the roots of a polynomial, this subroutine gives the 
coefficients of powers of s , in descending order. 

NUMERICAL RESULTS 

Although the example shown was chosen arbitrarily to demonstrate 
the design procedure, it merits some explanation, especially with regard 
to the filter. 

While the design procedure guarantees physical realizability, it 
does not ensure practicality, as shown by the example. There are two 
reasons for this: (1) the large performance index weighting factor requires 
very large feedback gains; (2) since 0 is not measured in this example, it 
must be derived synthetically. In contrast, the filter designed in the 
Monthly Progress Report dated 15 March 1965 was much more realistic, 
where 0 was measured and the feedback gains were much less. 
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MAIN PROGRAM 
CNTR L 2 



MPRNTS 
A(I, J) 

ALT L (I, 1) 
Cl (I, J) 

C2 (I, J) 


WRITE program title and input data 



Find coefficients of open loop characteristic equa- 
tion via SUBR . ALPHAS. Compute roots. WRITE 
ALPHA(I) and OLROOT(I). Also write ELINV for 
later use in FILTER program. 


READ Performance Weighting Factors CAPPA1 & 
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C OPTIMAL LITTLE-6 MAIN PROGRAM ( 5TH ORDER) 

C REQUIRES SPECIAL SUBROUTINES ALPHAS* MATMPY »MATPWR »ORDINV » POLYWG » SYNTH 1 

£****#-**#*****-****#***************************************************** 
DIMENSION A ( 5 » 5 ) '* AAT ( 5 * 6 ) , AB ( 5 » 1 ) ♦ AG ( 5 , 5 ) ,ALFOPT ( 12 ) *ALTL< 5 * 1 ) * 

2 ALTLTR ( 1*5)»ATP(5*5) *ATR< 5,5) , ATILDE ( 5,5 ) » ALPH A2 ( 6 ) , 

3 ALPHA ( 6 ) » A2 ( 5 * 5 ) » APPROX ( 1 Q ) » 

4 BLTL(5»1),C(5,5),C1(5,5),C2(5,5) >CLROOT ( 5 ) ,COEFF ( 6 ) » 

5 DSTAR (5,5) *ELINV(5»5)»EN(5,1) ,GLTL( 5 , 1 ) ,S ( 5,5 ) , 

6 GLTLTR (1,5) , INDEX (6) ,OLROOT (5),OPTALF(6) .ROOTS ( 10) 

7 , TE M P ( 5 ) 

^ **##**#.*#**** #■**#■**-******■** ******************************* ****** ******* 
COMPLEX OLROOT.CLROOT .APPROX, ROOTS, ALFOPT 
EQUIVALENCE ( AAT >BLTL ) ,( AB, EN ),( ATP , TEMP ) 

c ******* ****** ************ ********************************************** 

r 

N = 5 

NP=N+1 

C COMMENT ON INPUT 
C A- SYSTEM MATRIX 

C ALTL- ACTUATOR VECTOR 

C Cl AND C2 - PERFORMANCE MATRICES 

C 

RE AD ( 1 , 1 ) MPRNT S- 

READ! 1,2 ) ( ( A ( I ,J) »J = 1»N) ,1 = 1, N) 

READ! 1,2) (ALTL( 1,1) ,I = 1,N) 

READ (1*2) ( ( Cl ( I , J) , J = 1 ,N) , 1 = 1 ,N) , ( ( C 2 ( I,J),J = 1,N) , I =1 , N ) 

1 FORMAT (1012) 

2 FORMAT ( 5E10.0) 

£****##* ************** **** ******************** ************* ************* 
C WRITE INPUT DATA 
C 

WRITE (2, 3) ( ( A ( I , J ) »J=1*N)*I = 1*N) 

3 FORMAT ( 1H1,35X,28H CONTROL SYNTHESIS PROGRAM 2 //// 5X,9H A-MATRIX 

2 // (10X.5F15.4/) ) 

WR I TE ( 2 ,4 ) ( ALTL ( I » 1 ) * I = 1 *N ) 

2 » ( (Cl ( I , J) , J=1 »N ) » I =1*N) , ( (C2( I *J) ,J = 1 ,N) , 1 = 1, N) 

4 FORMAT ( //5X,16H ACTUATOR VECTOR // 5 ( 30X , Flo . 1 / / ) / / / 

2 5 X , 2 1H PERFORMANCE MATRICES // 8X,14H DRIFT MINIMUM// 

3 5 ( 10X.5E15.4// ) / 8X,13H LOAD MINIMUM / /5 ( 10X , 5E1 5. 4/ / ) ) 

£******************** ******************* ************** ******* *********** 
C OBTAIN COEFFICIENTS OF OPEN LOOP CHARACTERISTIC EQUATION (ALPHAS) BY 
C CALLING SUBR. ALPHAS. IF MPRNT S IS 1, THE S-MATRICES WILL BE 

C WRITTEN BY THE SUBROUTINE. 

C 

IF (MPRNTS.EQ.1)WRITE(2,14) 

14 FORMAT ( 1H1 »24H S-MATRICES OF OPEN LOOP ////) 

C 

701 CALL ALPHAS1N, A, ALTL, ALPHA, S, INDEX, MPRNT S , EL I NV * ENORM ) 

C 

IF (MPRNTS.EQ.2 )WRITF (2,15) ENORM 

15 FORMAT ( 1H1»30X»8H ENORM = E15.4.27H (SUM OF ABSOLUTE VALUES OF 

2 16H S-ZERO ELEMENTS ///) 
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c 

C FIND ROOTS OF CHARACTERISTIC EQUATION (OPEN LOOP) 

C 

DO 102 1=1.10 
102 APPROX ( I ) = ( 0 . * 0 . ) 

CALL ORDINV(NP, ALPHA) 

CALL R00T1 (N, ALPHA, OLROOT, APPROX, M) 

CALL ORDINV(NP, ALPHA) 

C 

C****** ****************************************************** *********** 

C WRITE RESULTS OF SUBR ALPHAS (ALPHA, OLROOT AND ELINV) 

C 

WRITE(2»5)N, (ALPHA! I ) ,I=1,NP> , (OLROOT ( I ) » I =1 ,N ) 

5 FORMAT ( /5X » 34H OPEN LOOP CHARACTERISTIC EQUATION // 

2 10X.45H COEFFICIENTS OF ASCENDING POWERS OF S ( 0 TO.I2.2H )// 

3 /10X»6E18.5////5X,43H ROOTS OF OPEN LOOP CHARACTERISTIC EQUATION 

4 /// 30X.5H REAL » 1 5X » 10H I MAG INARY// ( 20X , 2E20 . 5/ / ) ) 

C 

c 

WR I TE ( 2 » 1 6 ) M 

16 FORMAT (30X,I2»20H SIGNIFICANT FIGURES ///) 

C 

WR I TE ( 2 » 10 ) 

10 FORMAT ( 1H1 ) 

WRITE (2, 6) ( (ELINVt I ,J) , J = 1 , N ) , I =1 ,N ) 

6 FORMAT ( 3 1H ELINV (USED IN FILTER PROGRAM) / //5 ( 10X , 5E20. 6// > ) 

C 

c ************************************************************ *********** 

C READ PERFORMANCE WEIGHTING FUNCTIONS 
C 

931 READ(1,2) CAPP A1 , CAPPA2 

IF(CAPPA1.EQ. 1234567.) GO TO 50 
DO 933 1=1, N 
DO 933 J=1,N 

933 C( I , J)=CAPPA1*C1 ( I , J )+CAPPA2*C2( I , J) 

WR I TE ( 2 » 10 ) 

WR I TE ( 2 » 905 ) CAPPA1 ,CAPPA2, ( (C( I , J ) »J = 1,N) » I = 1 »N) 

905 FORMAT ( 5X » 30H PERFORMANCE WEIGHTING FACTORS // 

2 / 30X.30H DRIFT MINIMIZING (KAPPA-ROOF) E15.3 / 

3 / 30X.30H LOAD MINIMIZING (KAPPA-TILDE) E15.3 / 

4 ///31H WEIGHTED PERFORMANCE INDEX - C // 5 ( 1 OX , 5E 1 5.4/ / ) ) 

C 

C************* ******************* *********** ***************** *********** 

C COMPUTE COEFFICIENTS OF OPTIMAL CLOSED LOOP CHARACTERISTIC EQUATION 
C (OPTALF). S-MATRICES WRITTEN IF MPRNTS IS 1. 

C 

CALL POL YWG (ALPHA, ELINV, C,COEFF,N, ROOTS, APPROX, ALFOPT) 

C 

DO 203 I J=1 »NP 
I =N+2- I J 

203 OPTALFI I ) =REAL ( ALFOPT ( I J) j 
DO 107 1=1, N 

107 ALTLTR(1,I)=ALTL(I,1) 

c 

C************ ***********************#**#******-******* ******** *********** 
C FROM A, ALPHA, OPTALF AND THE TRANSPOSE OF ALT L , SUBR SYNTH1 COMPUTES 
C THE CONTROL VECTOR GLTL. 

C 
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CALL SYNTH1(N.A.ALPHA»0PTALF»ALTLTR»ATR»ATP»AAT ,en,bltl,ab,gltl, 

2 TEMP * A2 *DSTAR ) 

WR I TE ( 2 * 10 ) 

WR I TE ( 2 »7 ) ( (DSTARI I »J) *J=1*N) *I=1»N) 

7 FORMAT ( / / / 23H CONTROLLABILITY MATRIX /// 5 ( 10X , 5E20 . 6 / / ) ) 

C 

C******* ****** ******************* **************** *********************** 

c 


DO 109 I = 1 »N 

109 GLTLTRf 1 , I ) =GL TL t I .1 ) 

CALL MATMPYI ALTL , N . GLTLTR .N * 1 »AG) 

DO 111 I = 1 *N 
DO 111 J = 1 * N 

111 ATILDE! I » J ) =A ( I * J ) +AG ( I *J) 

^- # ****#**^**** ******** ************************************************** 

C DSC GLTL TO FORM ClOsED-LOOP SYSTEM MATRIX ATILDE. AGAIN USE SUBR 
C ALPHAS TO FIND ACTUAL CLOSED-LOOP ROOTS ACHIEVED BY CONTROL 

C VECTOR. 

C 

IF (MPRNTS.EQ.l (WRITE (2.23) 

23 FORMAT ( 1H1 *26H S-MATRICES OF CLOSED LOOP / / / / ) 

CALL ALPHAS! N» AT ILDE » ALTL * ALPHA2 »S» INDEX .MPRNTS.ELINV ♦ ENORM ) 

C 

IF (MPRNTS.EQ.2 ) WR I TE (2. 15) ENORM 
WR I TE ( 2 ♦ 10 ) 

WRITEI2.8) ((ATILDE (I»J).I=1»NJ»J=1»N) 

8 FORMAT!/// 47H A-T I LDE -TRANSPOSE (ATT USED IN FILTER PROGRAM) / 

2 //5< 10X.5E20.6//) ) 

C 

£*#*.*****# ******************************* ******************************* 
C 

CALL ORDINV! NP .ALPHA2 ) 

CALL ROOT 1 (N.ALPHA2 .CLROOT » APPROX » M ) 

WR I TE ( 2 » 1 0 ) 

WR ITE ( 2* 13) ( ROOTS! I ) > I = 1 *N ) » (GLTL! I»1)»I=1»N). (CLROOT ( I ) ♦ 1 = 1 »N) 

13 FORMAT! //5X.26H OPTIMAL CLOSED-LOOP ROOTS /// 30X.5H REAL.10X. 

1 10H IMAGINARY //5 ( 20X ,2E20.5// ) // 

2 5X.50H COMPUTED FEEDBACK CONTROL VECTOR (TERMS 1 THRU N) /// 

3 5(35X»E15.5//) // 5X.45H CLOSED LOOP ROOTS ACHIEVED BY CONTROL VEC 

AT OR /// 5(20X,2E20.5//) ) 

c #* # ** # * ********************************************** ****************** 
C 

GO TO 931 

50 WRITE(2*51) 

51 FORMAT! 1H1 ) 

CALL DUMP 
STOP 

END 
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Compute observability matrix OBSERV by SUBR. 
OBSMAT. If not observable, ICOLM is set equal 
to 100. 


Is system observable 


READ N values of POLES 


False pole . 1234567? 



PI = ICOLM 
= IRP1-1 



Take first IR poles on list and multiply to get 
coefficients of filter denominator (BETA) 


Compute BAGSUM 

Solve (OBSERV) x (DL) = (BAGSUM) for (DL) 


Convert DL- vector into GAMMA-matrix 


WRITE GAMMA as list of filter parameters 


Compute poles and zeros of filter and WRITE 


Compute poles of resulting closed-loop system and 
WRITE. 
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C FILTER ( 5TH ORDER SYSTEM) 

C REQUIRES SUBROUTINES OBSMAT, MATMPY 

c 

Q ********************** ********** ************************** ************** 

DIMENSION A2 (5,5 ) , A3 (5*5) ,A4<5»5 > ,ALFSYS< 11 ) ,ALPH( 11 ) .ALPHA! 6) . 

2 APPROX! 5 ) »ATGI ( 5. 1 ) .ATT! 5,5) . 

3 BAGSUM! 5 ) .BETA ( 6) .BETAl (6) ♦ DL<5), ELINV(5,5), GAMMA (5.5), 

4 GAMMA1 ( 5 ) . GAMS A! 1 1 ) .GAMS AH <11)»GLTL(5»1)» H ( 5 » 5 ) » HPLA ( 1 1 ) » 

A HSTAR! 5,5) ,FILZRO(5) , 

5 IJDLTL! 5.5) .NGLIST ( 5) » NRROOT ( 10 ) .OBSERV ( 5.5 ) .POLE ( 5 ) .POLES ( 5) , 

6 SAH! 5,5 ) ,SAH1 ( 5) .SUM! 5) , U ( 5 » 5 ) . VK ( 5 ♦ 6 ) , VNXM ( 5 . 5 ) , W ( 5 ) 

C 

COMPLEX APPROX, BETAl ,F I LZRO , NRROOT , POLE , POLES 
EQUIVALENCE ( H, HSTAR ) ,( POLES, F I LZRO ) 

C 

q ***************************************************** ****************** 

N = 5 

NP = N + 1 

C****** ********************************** ******************************* 

C COMMENT ON INPUT - 

C ALPHA- COEFFICIENTS OF OPEN-LOOP CHARACTERISTIC EQUATION 

C ELINV- AN OUTPUT OF A PROGRAM WHICH COMPUTED THE CONTROL VECTOR 

C ATT- TRANSPOSE OF THE A-TILDE MATRIX (FROM CNTRL1 OR CNTRL2 ) 

C GLTL- CONTROL VECTOR 

C HSTAR- ROWS! CARDS) REPRESENT SENSORS. THERE MUST BE N CARDS. 

C SOME BLANK IF LESS THAN N SENSORS. 

C 

READ (1,1) (ALPHA! I ) ,1=1, NP) 

RE AD (1,3) ( (ELINVI I ,J) ,J=1,N) » 1=1 »N) 

READ! 1,3) ( (ATT! I »J) ♦ J = 1 » N) »I=1»N) 

READ! 1,3) (GLTL ( I ,1) » I =1 ,N) 

READ! 1,3) ( (HSTAR! I »J) , I = 1 , N ) » J= 1 » N ) 

1 FORMAT ( 6E10.0) 

3 FORMAT! 5E10.0) 

C 

Q ******* ****** ********************************* ********** *************** 

C WRITE INPUT 
C 

WRITE (2, 6 ) ( { ATT ( I * J ) * J = 1 * N ) * I = 1 » N ) 

6 FORMAT ( 1H1 »20X»37H DESIGN FILTER TO APPROXIMATE DESIRED 

2 26H SYSTEM POLE CONFIGURATION //// 25H A-T I L DE-TRANSPOSE MATRIX 

3 ///(10X.5F18.6//) ) 

WR I TE ( 2 , 7 ) (GLTL( I ,1 ) . 1 = 1, N) 

7 FORMAT ( / / 26H G-LITTLE (CONTROL VECTOR) /// ( 30X , F20 . 6/ / ) ) 

C 

C DISCARD ZERO-ROWS OF HSTAR 
UJ =0 

DO 401 J= 1 »N 
HSUM=0 . 

DO 102 1=1, N 

102 HSUM=HSUM + H ( I , J ) 

IF (HSUM.EQ.O. ) GO TO 401 

JJ=JJ+1 

DO 103 1=1, N 

103 HI I » JJ ) =H( I , J) 

401 CONTINUE 

M=UU 

C 

WRITE(2,10) 

10 FORMAT ( 1H1 ) 

WR I TE ( 2 , 8 ) 

8 FORMAT! 13H HSTAR MATRIX //) 
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DO 51 1=1. M 
STO SUBRLS+M * 1 

18 FORMAT ( / 1 X » 7HSENS0R I1»5X.7( F15.3) ) 

51 WRITE(2»18) I.IHSTAR! J,I ) ,J=1,N> 

WR I TE ( 2 . 19 ) (ALPHA! I) » 1=1, NP) 

19 FORMAT ( ////50H COEFFICIENTS OF OPEN LOOP CHARACTERISTIC EQUATION 

2 26H (POWERS OF S FROM 0 TO N) / / / 20X ,6E 1 7 . 5 ) 

WRITE! 2 ,9) ( (ELINV1I »J)»J=1»N)»I = 1»N) 

9 FORMAT! 1H1.13H ELINV MATRIX /// 5 ( 20X , 5E 1 8 . 7/ / ) ) 

******* ****** ********************************************************** 
COMPUTE OBSERVABILITY MATRIX (OBSERV). IF SYSTEM IS NOT OBSERVABLE, 
ICOLM IS MADE EQUAL TO 100. SUBR OBSMAT ALSO KEEPS TRACK OF 
GAMMA POSITIONS VIA THE M BY ICOLM MATRIX IJDLTL. 

CALL OBSMAT (N.ATT »M»H»A2»A3 »VNXM » SUM.U »W ,NGLI ST , IJDLTL, 03SERV, 

2 ICOLM) 

WRITE ( 2 , 11 ) ( ( OBSERV (I,J),J=1,N)»I=1,N) 

11 FORMAT! 1H1.21H OBSERVABILITY MATRIX /// (10X.5E20.6) ) 

I F ( I COLM »EQ. 100 )GO TO 55 

ICOLM (IF NOT 100) DETERMINES NO. OF FILTER POLES REQUIRED 

******* ************************************** ***************** ********* 
I R P 1 = I COLM 
I R = I RP 1-1 

402 CONTINUE 

******************************** ********************* ****************** 
READ N CHOICES OF DESIRED FILTER POLES. PROGRAM WILL USE AS MANY AS 
REQUIRED, STARTING FROM TOP OF LIST. 

READ (1,1) (POLES! I ) ,1=1, N) 

POLERE=REAL ( POLES ( 1 ) ) 

FALSE FILTER POLE MAY BE USED AS DATA TO CAUSE CORE DUMP. 

IFtPOLERE.EQ. 1234567.) GO TO 450 

**************************** * ******************* ********** ****** ** *** * * 
03TAIN COEFFICIENTS OF FILTER DENOMINATOR (BETAS) 

DO 105 1=1, IR 
105 POLE! I ) =POLES( I ) 

CALL POLCO! IR, 1.0, POLE, BETA1) 

DO 107 I J= 1 » I RP 1 
I =IRP1-I J+l 

107 BETA! I ) =REAL(BETA1 ( I J) ) 

*********************************************************************** 
PUT OBSERV AND BAGSUM IN FORM SUITABLE FOR SIMULTANEOUS EQUATION SUB- 
ROUTINE (MATS). SOLVE ( OBSERV1X ( DL )=( BAGSUM) FOR DL. 

C 

DO 109 J = 1 , N 

109 BAGSUM! J)=0. 

DO 110 1 = 1, N 
DO 110 J=1,N 

110 A4! I , J) =0. 

DO 111 1 = 1, N 

111 A4( I , I ) =1. 

DO 405 I = 1 , 1 RP 1 

CALL MATMPY! A4 ,N,GLTL» 1 ,N,ATGI ) 
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DO 112 J = 1»N 

112 BAGSUM1J ) =BAGSUM ( J ) +BET A ( I ) *ATG I < J , 1 ) 
CALL MATMPY (ATT » N » 44 >N » N , A3 ) 


DO 114 K=1»N 
DO 114 J= 1 »N 

114 A4 ( K , J ) = A3 ( K * J ) 

405 CONTINUE 

DO 113 I = 1 *N 
DO 113 J = 1 » N 
113 VKt I . J)= OBSER V ( I » J ) 
DO 115 I =1 »N 

115 VK( I *N+1 )= BAGSUM! I ) 


CALL MATS t VK »DL * N * 1 ) 


THE IJDLTL MATRIX IS USED TO CONVERT THE VECTOR DL INTO A MATRIX GAMMA 


DO 1 1 7 J=1 » ICOLM 
DO 117 1=1 .M 
117 GAMMA ( I » J ) =0 . 

JJ = 1 

DO 406 J = 1 » I COLM 
DO 406 1=1. M 
I I = I JDLTL ( I * J ) +1 
GO TO ( 406.119) » I I 
119 GAMMA! I . J)=DL( JJ) 
305 JJ=JJ+1 
406 CONTINUE 


WRITE THE PARAMETERS OF THE MULTIPORT FILTER AS COEFFICIENTS OF S. 


WRITE(2.12)M,IR 

12 FORMAT ( 1H1 ,50X » 18H FILTER PARAMETERS //51X.I2.14H - PORT FILTER / 

2 /// 55H POLYNOMIAL COEFFICIENTS IN ASCENDING POWERS OF S (0 TO. 

3 12, 2H ) / ) 

DO 407 1=1, M 

WRITE! 2, 13 ) I, (GAMMA ( I , J ) , J = 1 , ICOLM) 

13 FORMAT! ///5X.14H NUMERATOR NO. ,12 //5X , 10E12.4 ) 

407 CONTINUE 

54 WR I T E ( 2 , 1 4 ) ( BE T A ( I) , I = 1 , I RP 1 ) 

14 FORMAT ( ///5X.19H COMMON DENOM I N ATOR / / 5X , 1 OE 1 2 . 4 ) 

WR I TE ( 2 , 1 C ) 


COMPUTE POLES AND ZEROS OF THE FILTER AND WRITE. 
WR I TE ! 2 » 17 ) 

17 FORMAT ( 50X , 13H FILTER ROOTS // ) 

DO 412 J J J= 1 »M 
DO 141 1 = 1, N 
141 APPROX! I ) = (0. ,0. ) 

JP=0 

DO 411 IJ=1, ICOLM 

I = I COLM + l-I J 
GAM1=GAMMA ( JJJ, I ) 

GAM2=ABS( GAM1 ) 

IF ! GAM2 .LE. .00001 .AND. JP.EG.O ) GO TO 411 
JP= JP+1 

GAMMA 1 ( JP ) =GAM 1 
411 CONTINUE 
N A = JP- 1 

IF ( MA.LF.l ) GO TO 412 

CALL ROOT 1 ( NA, GAMMA 1 ,F I LZRO , APPROX .MS I G ) 
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21 FORMAT! ///5X ,14H NUMERATOR NO. 12/ (30X.2E20.6) ) 

WRITE! 2.21 ) JJJ . (FILZRO! J) ,J=1,NA) 

412 CONTINUE 

22 FORMAT (////5X.19H COMMON DENOMINATOR / (30X.2E20.6) ) 

WRITE I 2. 22) (POLE! I)»I = 1*IR) 

USING THE COMPUTED FILTER, DETERMINE THE POLES OF THE CLOSED LOOP. 

NSAH=N-1 

NGAM= I COLM- 1 

NGSP1 =NSAH+NGAM+l 

CALL MATMPY! EL I NV » N , H , M , N , S AH ) 

DO 121 1=1 .NGSP1 
121 GAMSAH ( I ) =0. 

DO 129 1=1, M 
DO 123 K = 1 * I COLM 
123 GAMMA 1 ( K ) =GAMMA ( I , K ) 

DO 125 J=1 ,N 
125 SAH1 ( J) =SAH( J, I ) 

DO 127 11=1, NGSP1 
GAMSA! I I ) =0. 

I 1 = 1 I-NSAH 

JGAMIN = MAXO (11,1) 

I 2 =NGAM + 1 

JGAMAX= MINO! 12, I I ) 

DO 127 JGAM= JGAMI N » JGAMAX 
JSAH=I I+l-JGAM 

127 GAMSA! I I ) =GAMSA ( I I ) +GAMMA 1 ( JGAM)*SAH1 ( JSAH) 

DO 129 11=1, NGS P 1 

129 GAMSAH! I I ) =GAM SAH ( I I ) +GAMSA (II) 

C 

£*****************»**************•*****»*****.*« *********** *************** 
NPRP1=N+IR+1 
DO 133 1=1, NPRP 1 
ALFSYS! I ) =0. 

II = 1 — N 

JM I N=MAX0 ( 11,1) 

I 2=IR+1 

JMAX=MI NO ( 12,1 ) 

DO 133 J= JM IN, JM AX 
K= I +1— J 

133 ALFSYS! I )=ALFSYS( I ) + BE TA ( J ) *ALPHA ( K ) 

C 

NPR=N+ I R 
NGSP2=NGSP1+1 
DO 135 I =NGSP2 , NPRP 1 
135 GAMSAH! I ) =0. 

DO 137 1=1 »NPRP1 
137 ALPH! I)=ALFSYS( I)-GAMSAH(I) 

DO 139 1=1 ,NPRP1 
J=NPRP1+1-I 
139 HPLA! I ) =ALPH( J) 

CALL ROOT 1 (NPR, HPLA, NRROOT, APPROX, ISIG) 

WRITE(2»15) (NRROOT ( I ), 1=1 , NPR ) 

15 FORMAT! 1H1,20X,25H RESULTING POLE POS I T IONS// / ( 1 5X , 2E20. 6/ / ) ) 

C 

C **************** *** ************ ** *■*«- ** * ** * * *•** -* * * * * ** * *# ** * * * * ** * * * 
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55 

16 

450 


GO TO 402 
WR I TE ( 2 * 1 6 ) 

FORMAT ( /////22H SYSTEM NOT OBSERVABLE) 

CONTINUE 

WR I T E ( 2 » 1 0 ) 

CALL DUMP 

STOP 

END 
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COMPUTE ALPHAS WITH DOUBLE PRECISION ARITHMETIC ( INPUT , OUTPUT S.P.) 


C REQUIRES SPECIAL SUBROUTINES MATMPY , DMATMP 

£******* ****-******-**-!(^-s:-****»#tt**#****#*'tf'-i<-'****» **##■#**•***•******#■#•* ******* 

SU5ROUT I NE A LPHAS ( N , AS ♦ ALTLS , ALPHAZ »S5 , I NDEX .MPRNT S .EL I NV , E NORMS ) 


C 

DIMENSION AS(N,N)»ALTLS(N,1) , ALPHAZ (N) »SS( N ,N > .INDEX(N) » 

2 ELINV(N.N) * 

3 A(5 ,5) »ALTL( 5,1 ) » ALPHA ( 6 ) , S t 5 , 5 ) ♦ SA ( 5 . 5 ) . ROW ( 5,1 ) 


C COMMENT ON DIMENSIONING - ALTHOUGH DIMENSIONED FOR N=5, THE WRITE 
C STATEMENTS ARE GENERAL FOR N LESS THAN 25. 

C 


DOUBLE PRECISION A .ALT L .ALPHA ,S , SA , TRACE .DFLOT J, ROW , ENORM 


********* ************ ******* ***************************************** 
C IF MPRNT S= 1 » S-M AT RICES ARE TO BE WRITTEN 
GO TO (1,2) » MPRNT S 

1 I PRNT = 1 

IF(N.GT.IO) 1PRNT=2 
IFIN.GT.20) IP R NT = 3 

2 CONTINUE 


C 

C GET INPUT INTO DOUBLE PRECISION 
DO 101 1=1, N 
ALTL< 1,1) =ALTLS ( 1,1) 

DO 101 J= 1 »N 
101 A ( I , J ) = AS ( I , J) 

DO 3 I = 1 ♦ N 
DO 3 J = 1 ,N 

3 SA ( I , J ) =0.00 
DO A K = 1 » N 

4 SA ( K,K ) =1 .DO 


C 


C USE LEVERRIER ALGORITHM TO COMPUTE SUCCESSIVE ALPHAS AND S-MATRICES 
C ( N— 1 THRU 0) 

C 


DO 42 J = 1 » N 
NN=N-J+1 

CALL DMATMPt A, N , SA , N »N ,S ) 

TRACE=C.D0 

DO 6 K=1»N 

6 TRACE= TRACE + S( K,<) 

FLOT J= FLOAT ( J ) 

DFLOT J=FL0TJ 

ALPHA ( NN ) = -TRACE /DFLOT J 
DO 8 K = 1 » N 

8 S(K»K)=S(K»K)+ ALPHA ( NN ) 

I NDEX ( NN ) =NN-1 
DO 10 I = 1 »N 
DO 10 J J= 1 , N 
10 SA ( I , JJ )= S< I , JJ) 

DO 103 1=1, N 
DO 103 JD= 1 , N 
103 SSI I , JD)=S( I * JD ) 

C 

c IF MPRNTS=1 *WRITF S-MATRIX 
GO TO( 51 ,405 ) , MPRNT S 
51 WRITE! 2,12) INDEX ( NN ) 

12 FORMAT ( ///5X,7H I NDFX= IA//) 
22 DO 25 < = 1 ♦ I PRNT 
JMI N= ( < — 1 )*10 + 1 
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MAX=K*10 

JMAX=MI NO ( N »m AX ) 

WR I TE ( 2 * 1 3 ) JM IN* JMAX 

13 FORMAT ( 5X *8H COLUMNS > I 3 * 5H THRU*I3//) 
DO 25 1=1 ,N 

25 WR I TE t 2 * 1 A ) ( SS ( I * JM ) * JM = JM I N , JMAX ) 

14 FORMAT ( 1 OX *1 OF 12. 4/) 

405 CONTINUE 


THE 


ZERO-TH S-MATRIX SHOULD BE 
CHECK ON ROUNDOFF ERROR 
IS ENDED. 


EQUAL TO ZERO. IT IS COMPUTED AS A 
AFTER IT IS COMPUTED, USE OF ALGORITHM 


IF ( INDEX! NN) >42,42*31 

31 CALL DMATMP(S,N,ALTL,l,N,ROW) 
INDEXN=INDEX(NN) 

DO 32 1=1, N 

32 EL I NV ( I NDEXN , I ) = ROW (1,1) 

42 CONTINUE 


GATHER LOOSE ENDS 


**** * if ■**■***#***** * * # ^ # * * #. 


ALPHAZ ( N+l ) =1.0 
DO 105 1=1, N 

105 ALPHAZ ( I ) =ALPHA ( I ) 

INDEX (N+l )=N 
DO 43 1=1, N 

43 ELINVI N, I )= ALTL1 1,1) 
ENORM=0. 

DO 44 1=1, N 
DO 44 J = 1 , N 

44 ENORM=ENORM+DABS(S( I ,J) ) 
ENORMS=ENORM 

IF ( MPRNTS.EQ. 1 ) WRITF (2,10P) 
100 FORMAT ( 1H1 ) 

RETURN 

END 
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c SUBROUTINE POLYWG ( ALPHA , EL I NV ,C. COEFF , N , ROOTS , APPROX .ALFOPT ) 

C REQUIRES SPECIAL SUBROUTINE ORDINV 

c***********************#*^**************»*»**»****, ######1Ht#1MHt##>iHf## 

C THIS SUBROUTINE IS A MECHANIZATION OF EQUATIONS (44) AND (57) OF THE 
L PAPER ON HI GHER ORDER SYSTEM DESIGN BY BASS AND GURA. 

O 

DIMENSION ALPHA (1) * COEFF ( 1 ) »ELINV(N»N).C<N.N) .ROOTS ( 2 ) .ALFOPTI 1 ) 

C NOTE ON DIMENSIONS -(1) INDICATES CALLING ROUTINE TO BE DIMENSIONED 
c (N+l). (2) INDICATES (N*2). 

C 

COMPLEX ROOTS. APPROX .ALFOPT 

c 

C************************************ # * ## * # * #############<############it# 

NX2=N*2 

NP1=N+1 

DO 101 1=1. NP1 
101 COEFF ( I ) =0 • 

S I GN I = 1 . 

NM1=N-1 

C 


C*****************************************************^^*^^*^^^ 

C COMPUTE EVEN COEFFICIENTS OF THE POLYNOMIAL DELTA ( 2N ) . ODD COEFFIC- 
C I ENTS ARE ZERO. 

C 

DO 430 I = 1 »NM1 

S IGN I = -SIGN I 

JMIN=1 

JMAX= I 

1X2 = I *2 

I F ( IX2.GT.N ) JM I N= IX2-N+1 
C 

C COMPUTE ALPHA-HAT fERM (PART 1) 

C 

SIGNJ=+1. 

JEVN=JMIN-2* ( JMIN/2 ) 

IF ( JEVN.GT .0 ) S I GN J=-l . 

DO 105 JP 1 = JMI N . JMAX 
S IGNJ=-S IGN J 
JS= I X 2- JP 1+2 

105 COEFF ( I + 1 ) =COEFF ( 1 + 1 )+ALPHA( JP1 ) *ALPHA ( JS) *SIGNJ 

COEFF ( I + 1 ) =2 .*COEFF ( 1+1 ) +SIGNI*ALPHA ( 1+1 )*ALPHA( 1 + 1 ) 

C**«^***»* *************** # # *^ ## *^ ## 

IP ( I .FQ.NM1 ) GO TO 430 
JMI N=1 

I F ( IX2.GT.NM1 ) JMI N= IX2-N+2 
JEVN=JMIN-2* ( JMIN/2 ) 

S I GN J= 1 • 

IF ( JEVN.GT. 0 ) SIGNJ=-1. 

PART2A=0. 

C 

C COMPUTE EPSILON TERM ( 2 PARTS) 

DO 110 JP1=JMIN , JMAX 
S I GNJ=-S I GN J 
ANS=0 . 

JS=IX2-JPl+2 
DO 107 J J= 1 . N 
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DO 107 KK = 1 * N 

107 ANS=ANS+ELINV< JPl. JJ)*C< JJ.KK)*ELINV< JS.KK) 

110 PART 2 A = P ART2 A + SIGNJ*ANS 
PART 2B = 0 • 

DO 120 JJ=1 iN 
DO 120 KK=1*N 

120 PART 2B = P ART 2B + ELINV< I+1»JJ)*C( JJ»KK)*ELINV( I+liKK-l 

c 

C ADO EPSILON TERM TO ALPHA-HAT TERM 

COEFF ( I +1 ) =COEFF ( I +1 ) + 2.*PART2A + PART2B*SIGNI 
430 CONTINUE 


C 

c 

£***** ******** ******** 


ft************************************************* 


c 

C 2N-TH AND ZERO-TH TERM ARE COMPUTED SEPARATELY 

C 

C 

C COEFFICIENT OF S**2N - 
NEVN=N-2* ( N/2) 

COEFF ( N+l ) =-l . 

IF (NODD.GT.O > COEFF ( N + l ) =1 . 

COEFF ( 1 ) =0. 

DO 124 J J = 1 » N 
DO 124 KK=1.N 

124 COEFF ( 1 ) = COEFF ( 1 ) + E L I NV ( 1 . J J ) *C ( J J » KK ) *EL I NV ( 1 . KK) 
COEFF ( 1 ) = COEFF ( 1 ) + ALPHA< 1 ) *ALPHA < 1 ) 


C******************** **************************************** *********** 

C PART 2 OF COEFFICIENT OF S**(2N-2) 

C 

SIGNJ=-COEFF (N+l ) 

C PART 2 = 0. 

DO 126 J J= 1 * N 
DO 126 KK = 1 * N 

126 PART 2 = ELINV(N.JJ)*C( J J . KK ) *EL I NV ( N , KK ) 

C 

C ADD PART2 TO PARTI ( ( N- 1 ) TERM) 

COEFF (N)=COEFF(N)+SIGNJ*PART2 


C******************** ***************************************** ********* 


C WRITE HEADING FOR INTERNAL POLYWG WRITE STATEMENTS. 

WRITE ( 2*11 ) 

11 FORMAT ( 1H 1 15X.46H SUBROUTINE POLYWG PRINTS COEFFICIENTS OF 


EVEN 


2 35H POWERS OF S (ODD POWFRS AR.F ZFRO), / 

3 20X.50H N ROOTS OF POLYNOMIAL FORMED 3Y EVEN COEFS. ONLY* 

4 23H N L.H.P. ROOTS OF 2NTH / 20X.18H ORDER POLYNOMIAL. 

5 52H AND THE COEFFICIENTS GENERATED BY THE L.H.P. ROOTS. 

6 ) 


* 


C 

C WRITE COEFFICIENTS COMPUTED ABOVE. 
C 


WRITEI2.12) 

12 FORMAT (///// 20X.31H POWER OF S COEFFICIENT // ) 

DO 51 I = 1 , NP 1 
NNX2=2* 1-2 


51 WRITE(2.13)NNX2.COEFF( I) 
13 FORMAT ( 24X , I 3. 12X .E15.8) 


£»******#**************■******************■******************************* 

C FIND ROOTS OF POLYNOMIAL HAVING THE N+l COEFFICIENTS PREVIOUSLY COM- 
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n n n n n nnonn nn 


PUTED. THESE ARE THE ROOTS OF THE FORM ( S**2 - ROOT). 

CALL OR DINVt NP1 , COEFF ) 

CALL ROOT 1 <N, COEFF, ROOTS, APPROX, M) 

WR I T E ( 2 » 1 4 ) (ROOTS! I ), 1=1, N) 

14 FORMAT ( ////29H ROOTS FROM EVEN COEFFICIENTS / 

2 //(20X.2E20.7) ) 


TAKE THE COMPLEX SQUARE ROOTS (OF THE PREVIOUS ROOTS) WHICH ARE IN THE 
LEFT HALF PLANE. THESE ARE THE OPTIMAL CLOSED-LOOP ROOTS. 

DO 404 1=1, N 

ROOTS ( I ) =CSQRT (ROOTS! I ) ) 

ROOT RE = REAL ( ROOT S ( I ) ) 

I F ( ROOTRE.LT. 0. )G0 TO 404 
ROOTS! I ) =-ROOT S ( I ) 

404 CONTINUE 

WR I TE ( 2 , 1 0 ) 

10 FORMAT ( 1H1 ) 

WRITE( 2,15) (ROOTS(I ),I=1,N) 

15 FORMAT! 10X.30HROOTS WITH NEGATIVE REAL PARTS // (2E20.7)) 


MULTIPLY THE ROOTS TO 
CHARACTERISTIC 


£ * *-*-** ****-* -** *** **# * **.# * # ** * * * 
GET THE COEFFICIENTS OF THE DESIRED CLOSED-LOOP 
POLYNOMIAL. 


CALL POLCO(N,1.0, ROOTS, ALFOPT) 

WRITE (2, 16) 

16 FORMAT ( ///50H COEFFICIENTS OF POLYNOMIAL GENERATED BY ROOTS IN , 

1 15HLEFT HALF PLANE / / 1 OX , 10HPOWER OF S 2 6X , 1 1 HCOEFF I C I ENT / 

2 40X , 4HR EAL 14X , 9H I MAG I NAR Y // ) 

NP=N+1 

DO 53 1=1, NP 
NM I =NP- I 

53 WRITE! 2 ,17) NMI , ALFOPT ( I ) 

17 FORMAT! 14X , I 3 , 1 2X » 2 E 20 . 8 ) 

RETURN 

END 
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RETURN 








SUBROUTINE SYNTH 1 ( N * A .ALPHA »DSI RD » ALT LTR » ATR , ATP ,AAT , EN» BLTL ♦ AB« 

2 GLTL »TEMP » A2 »DSTAR ) 

C 

C EQUIVALENCE t AA T ,BLTL > . ( EN. AB ) . ( ATP ,TEMP ) 

C 

DIMENSION A t N* N ) * ALPHA! 2 ) » ALT LTR ( 1 ,N ) , AAT ( N *N ) » ATP ( N ♦ N ) > ATR ( N , N) * 

2 AB(N»1 ) »A2 (N,N) *BLTL ( N » 1 ),DSTAR(N,N)*DSIRD(2).EN<N,1), 

3 GLTL(N*1)»TEMP(N) 

C 

C COMMENT ON DIMENSION - (2) INDICATES DIMENSION OF N+l IN MAIN PROGRAM. 
C 

( 2 ************* ******** **********************#*****.##.#.*****.**.**#*.**.**.***.* 
DO 1 1 = 1 *N 
DO 1 J = 1»N 
ATP ( I * J ) =0 • 

1 ATR ( I * J ) = A ( J * I ) 

DO 2 I *1 »N 

2 ATP ( I * I ) = 1. 

C 

C****** ******* *********************************************** *********** 

C COMPUTE DSTAR (TRANSPOSE OF CONTROLLABILITY MATRIX). AAT IS SET EQUAL 
C TO DSTAR TO AVOID DESTROYING DSTAR IN THE SIMULTANEOUS EQUATION 

C SUBROUTINE (SIMEO). 

C 

DO 7 K = 1 * N 
DO 101 1=1, N 
DSTAR (K, I ) =0. 

DO 101 J= 1 * N 

101 DSTAR ( K, I ) =DST AR ( K * I ) +ALTLTR ( 1 , J ) *ATP ( J , I ) 

DO 3 1 = 1, N 

3 AAT ( K » I )=DSTAR(K, I ) 

CALL MATMPYl ATP , N , ATR »N , N, A2 ) 

DO 4 1 = 1 ,N 
DO 4 J= 1 »N 

4 ATP ( I , J ) = A2 ( I , J ) 

7 CONTINUE 
C 

C ******************** *************************************************** 
C SOLVE (DSTAR)X(BLTL)=(EN) FOR BLTL 
C 

DO 8 I = 1 ,N 

8 EN< I , 1 ) =0. 

EN(N,1)=1. 

SCALE=1 • 0 

CALL SIMEQ(N,N,1 , AAT, EN, SCALE, TEMP, MM) 

C 

C THE SOLUTION VECTOR BLTL IS THE FIRST COLUMN OF AAT (SEE COMMENT ON 
C EQUIVALENCE STATEMENT) 

C 

GO TO (402,52,53) , MM 

52 WR I TE ( 2 , 14 ) 

14 FORMAT ( ////42H UNDERFLOW OR OVERFLOW IN SUBROUTINE SIMEQ) 

GO TO 402 

53 WR I TE ( 2 , 15 ) 

15 FORMAT ( ////51H SYSTEM NOT CONTROLLABLE ( DSTAR-MATR I X IS SINGULAR)) 
402 CONTINUE 

C 

£***********************************-**********.****.**** ***************** * 
C COMPUTE THE CONTROL VECTOR GLTL, THIS IS THE PRIMARY RESULT OF THIS 
C SUBROUTINE AND OF THE MAIN PROGRAM. 

C 

DO 9 1=1, N 
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9 GLTL ( I * 1 ) =0 * 

DO 10 1=1. N 
DO 10 J=1*N 

10 ATP ( I .J )=0. 

DO 11 I = 1 * N 

11 ATP ( I . I ) =1 • 

DO 13 < = 1 * N 

CALL MATMPYIATP.N.BLTL.l.N.AB) 

DO 12 1=1. N 

12 GLTLI I . 1 )=GLTL< I .1 ) + < ALPHA ( K ) -DS I RD ( K > >*AB ( I ♦ 1 ) 
CALL MATMPYI ATP.N.ATR.N.N.A2) 

DO 13 1=1. N 
DO 13 J= 1 »N 

13 A T P ( I , J )=A2( I . J) 

C 

RETURN 

END 
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SUBROUTINE OBSMAT 


Input: N, ATT, M, H 

Dummy: A2, A3, VNXM, 

SUM, U, W, NGLIST 
Output: IJDLTL, V, 1COLM 


Set initial values 


VNXM + next M possible 
columns of V (Column index = 
IV) 



Compute mag- 
nitude of V 

VMAVM6 = 

. 00006* VMAG 


Compute unit Check independence - 
vector U(I, 1) Is WMAG > VMAVM6? 


Add IV to reject list, NGLIST 
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C OBSERVABILITY MATRIX 

SUBROUTINE 03SMAT ( N , ATT ,M ,H » A2 » A3 ,VNXM ,SUM »U , W , NGL I ST , I JDLTL, 

2 V»ICOLM) 

DIMENSION A T T ( N , N ) * H ( N * N ) *A2(N*N)»A3(N*N) , VNXM ( N ,N ) ,'J(N*N)» 

2 I JDLT L ( N * N ) »V(N*N) , SUM ( N ) *W<N) » NGL I ST ( N ) 

q ###***##***#******-** ************ ** ****-**•-**--***- * ******* ******* *********** 

C 

NMM=N-M 
DO 4 I = 1 »M 
DO 4 J = 1 * N 
A I JDLT L ( I » J) = 0 
C 

C***** ******** ** ***** **** ********* * ************************************* 

C TAKE FIRST M COLUMNS ( NXM H-MATRIX) 

C 

DO 5 1 = 1 »N 
DO 5 J=1 9 N 
5 A2 i I * J ) =0 • 

DO 7 1=1, N 
7 A2 ( I , I ) = 1 • 

J V = 0 
I ATP= 1 
VMAGSM=0. 

VMAV^6=0 # 

NGL I ST ( 1 ) =0 
ML I ST = 1 
ICOLM=0 

c 

(2 * ******************************* ********* ******************* *********** 

9 CALL MATMPY ( A2 *N,H,M,N,VNXM) 

ICOLM= ICOLM+1 

I v=o 
c 

( 3 ******* ****************** ******* ***************** ********************** 

C COMPARE COLUMN INDEX WITH N.G.LIST. ELIMINATE COLUMNS ON LIST. 

C 

10 IV=IV+1 

DO 12 1=1. MUST 
I F ( NGL I ST ( I ) -I V ) 12.10.12 
12 CONTINUE 

IF(IV-‘‘-l)14»28.55 

14 CONTINUE 

I JDLTLt I V . I COLM ) = 1 
C 

Q ****** ##•***•»•********* **#***•#»*******■*■**■)<■*** *» ******************* *****■*#• 

C TAKE A COLUMN AT A TIME 

C 

JV=JV+1 
DO 15 1=1. N 

15 V( I , JV) =VNXM( I . IV) 

I F ( JV-D35.110. 16 

110 VMAGSQ=0 

DO 111 I =1 »N 

111 VMAGSQ = VMAGSQ+V ( I »JV)*V< I ,JV) 

VMAG=SORT (VMAGSQ) 

VMAVM6 = • 0G0006*VMAG 
DO 112 1=1. N 

112 U( I ,JV) =Vt I .JVJ/VMAG 
GO TO 10 

C 

£**#*********************■* «♦.*.*.»***«*♦****.«*♦ *********************** 
C COMPUTE ORTHOGONAL VECTOR W 


5-28 


n n r> n n n n r> 


16 JVM1=JV-1 
DO 19 J=1»N 
SUM ( J ) = 0 . 

DO 18 1=1* JVM1 
DO 18 K = 1 * N 

18 SUM ( J ) = SUM ('J ) + U ( K » I ) *V ( K * JV ) *U ( J * I ) 

19 W ( J ) =V ( J , JV) -SUM ( J ) 

•IHH*-**#***# ************ a-**-*-*-****** ********** *•#****•»**■*•**** **•********.***.#.* 

IF MAGNITUDE OF W IS ZERO*REJECT COLUMN AND TRY NEXT 

WMAGSQ =C. 

DO 21 I = 1 * N 

21 WMAGSQ = WMAGSQ + W(I)**2 
WMAG = SORT (WMAGSQ) 

IFtWMAG - VMAVM6 ) 23 ,24,24 
23 ML I ST = ML I ST +1 
NGLISTt MLIST) = IV 
I JDLTLI I V * I COLM ) =0 
JV=JV-1 
GO TO 10 
2 A CONTINUE 
DO 25 1=1, N 

25 U< I , JV) = W(I) /WMAG 
VMAGSQ=0. 

DO 26 1=1, N 

26 VMAGSQ = VMAGSQ + V ( I , JV ) *V ( I , JV ) 

VMAG=SQRT ( VMAGSQ ) 

VMAGSM= VMAGSM+VMAG 

VMA VM6= . 00 Q00l*VMAGSM/ FLOAT ( JV ) 

I F ( JV-N 127,40,35 

27 IF( IV-M) 10,28,28 

COMPUTE NEXT POWER OF A-TILDE-TRANSPOSE 

28 CALL MATMPY (ATT ,N»A2,N,N»A3 ) 

IATP=IATP+1 

I F ( I AT P-N-l >29,32,35 

29 DO 30 1=1, N 
DO 30 J= 1 » N 

30 A2( I , J)=A3( I ,J) 

GO TO 9 

32 I COLM=100 

34 GO TO 40 

35 WR I TE ( 2 , 36 ) 

36 FORMAT ( /////27H ERROR IN OBSMAT SUBROUTINE) 

40 RETURN 

END 
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SUBROUTINE DMAT MP ( A , NR ♦ B , NC » N , C ) 

DIMENSION A(NR,N) ,B(N,NC) »C(NR,NC) 

DOUBLE PRECISION A,B,C 

DO 1 1=1, NR 

DO 1 K = 1 * NC 

C( I ,K ) =0.D0 

DO 1 J = 1 * N 

1 C< I *K )=C( I *K)+A( I , J) *B( J*K) 

RETURN 

END 


SUBROUTINE MAT MPY ( A , NR , B , NC , N , C ) 
DIMENSION A(NR,N) ,B(N,NC) .C(NR.NC) 
DO 1 1=1, NR 
DO 1 K= 1 , NC 
C( I »K)=0«0 
DO 1 J= 1 ,N 

1 C< I ,K)=C( I,K)+A( I ,J)*B< J,K) 

RETURN 

END 


SUBROUTINE ORDINV(N,V) 

DIMENSION V ( N ) 

NHALF=N/2 

DO 1 1=1, NHALF 

N1 = N + 1— I 

A= V ( N 1 » 

V ( N 1 ) = V < I ) 

1 V ( I ) = A 
RETURN 
END 
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SYMBOL DICTIONARY 



Except as otherwise noted, subscripts run from 1 to N 
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Mathematical 



Fortran 

Equivalent, 



Symbol 

if any 

Definition 

Used in 



ALFSYS(I) 
1=1, N+R+l 


ALPH(I) 
1=1, N+R+l 


ALPHA(I) 
1=1, N+l 


ALPHAZ(I) 
1=1, N+l 


i=o, n 


Coefficients of 
optimal closed-loop 
characteristic equa- 
tion as computed by 
POLYWG. They are 
complex but the 
imaginary part is 
non- zero only due to 
computing error. 
They are also in the 
wrong order. (See 
OPTALF) 


POLYWG 

CNTRL2 



Coefficients of 
A(S)A n _ v (S) in 
Eq. (28b) 

FILTER 

Coefficients of 

A 2n _ v in Ec l- (28b) 

FILTER 



Coefficients of the CNTRL2 

characteristic equa- FILTER 

tion of the plant, SYNTH1 

A(S), in ascending ALPHAS 

powers of S from 
0 (1=1) to n (I=N+1 ). 


Dummy variable ALPHAS 

used in ALPHAS to 
indicate single pre- 
cision (ALPHA is 
double precision in 
ALPHAS) 
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Fortran 

Symbol 


ALPHA2(I) 
1=1, N+l 


ALT LS(I, 1) 


Mathematical 
Equivalent, 
if any 



Definition 



n-vector which is 
called the actuator 
vector. From the 
equation 
x = Ax + ai|/ 


Dummy used in 
ALPHAS to indicate 
single precision. 


CNTRL2 


ALPHAS 


ALTLTR(1, I) 


Transpose of ALTL CNTRL2 

SYNTH1 


APPROX(I) 


ATGI(I, 1) 


ATILDE(I, J) 


Guess at roots to 
assist ROOT1 sub- 
routine (library). 



CNTRL2 

FILTER 

POLYWG 



Analogous to A, CNTRL2 

except it defines the 
closed loop system. 


Dummy matrix used SYNTH1 
to represent suc- 
cessively higher 
powers of A ‘ 
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Fortran 

Symbol 


Mathematical 
Equivalent, 
if any 


Definition 


Used in 


ATR(I, J) A~ Transpose of A SYNTH1 

ATT(I, J) (A) * Transpose of the CNTRL2 

closed-loop system FILTER 
matrix 


A2(I 9 J) Dummy matrices 

A3(I, J ) 

etc. 



BLTL(I, 1) b Vector resulting from CNTRL2 


the solution of SYNTH 1 

D*b = e n 


c(I,J) c The weighted per- CNTRL2 

formance index. POLYWG 


CLROOT(I) 


Achieved closed 
loop poles 

CNTRL2 

C 1(1, J), 
C2(I, J) 


The performance 
indices of 
c = K 1 C1 + K 2 C2 

CNTRL2 
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Fortran 

Symbol 

Mathematical 
Equivalent, 
if any 

Definition 

Used in 

COEFF(I) 
1=1, N+l 


Dummy array used to 
compute the optimal 
coefficients ALFOPT 

POLYWG 

DL(I) 

d 

The coefficients of 
the filter numerators 
arranged consecu- 
tively. See definition 
following Eq. (31). 

FILTER 

DSIRD(I) 
1=1, N+l 

a • 
l 

i=o, n 

Coefficients of the 
desired closed loop 
characteristic equa- 
tion. Corresponds 
to OPTALF(I). 

SYNTH 1 

DSTAR(I, J) 

D* 

The transpose of the 
controllability 
matrix, D 

CNTRL2 
SYNTH 1 

ELINV(I, J) 

L" 1 

Inverse of L. 

L" 1 = (Sja, S2a, . . . , 
S n a)* 

alphas 

CNTRL2 

FILTER 

EN(I, 1) 

e n 

n 

e = 

i — i 

CD CD • • . i — h 

-nth 

element 

SYNTH 1 
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Fortran 

Symbol 


Mathematical 
Equivalent, 
if any 


Definition 



Used in 


Error norm-sum of 
the absolute values of 
the elements of the 
final S-matrix com- 
puted (S Q ) by 
ALPHAS. Used as a 
check on computa- 
tional accuracy. 


Used repeatedly to 
compute and write 
the filter zeros. 


Each of M rows of 
GAMMA represents 
the coefficients of 
increasing powers of 
s of each of M filter 
numerators. 

1=1, 2, . . . , ICOLM 

corresponding to 

o 1 r 

S f s ,...s 



FILTER 


FILTER 

OBSMAT 


GAMSAH(I) 

1=1, N+ICOLM+1 


Coefficients of s in FILTER 
2nd term of Eq. (28b), 


1V1 

1 A U)< S > 


J (h 1 • S.a) 

j = l 
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Fortran 

Symbol 


GLTL(I, 1) 


GLT LTR( 1, 1) 


HPLA(I) 

1=1, N+R+l 


HSTA R(I, J) 


Mathematical 
Equivalent, 
if any 





Definition 



Control vector, from CNTRL2 
the equation FILTER 

x = Ax + a4*, SYNTH1 

where 4 1 = g • x 




Transpose of the 
control vector 


The sensor matrix. 
Each of M sensors 
represented by a 
column of H. 


The elements of 
ALPH(I) in reverse 
order 


T ranspose of H 



Tells maximum 
number of zeros of 
filter (ICOLM-1). 
Used as an indicator 
of non- observability 
by setting equal to 


CNTRL2 


FILTER 

OBSMAT 


FILTER 


FILTER 


Number of columns FILTER 

in GAMMA(I, J). OBSMAT 
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Fortran 

Symbol 


Mathematical 
Equivalent, 
if any 


Definition 


Used in 



Used to allow print- ALPHAS 
out of subscript zero, CNTRL2 
which is not allowed 
in Fortran. 


Determines printing ALPHAS 

format in ALPHA.S. 

Value depends on 
size of array to be 
printed. 


Option to print ALPHAS 

S-matrices of Subr. 

Alphas decides by 
input value of 
MPRNTS. Printing 
occurs if 

MPRNTS = 1, does 
not if MPRNTS = 2. 


Order of the plant All 

characteristic 

equation. 

List of rejected col- OBSMAT 

umn numbers. Used 
to compute observa- 
bility matrix. 

Closed loop poles of FILTER 

system with filter. 








Fortran 

Symbol 

Mathematical 
Equivalent, 
if any 

Definition 

Used in 

OBSERV(I, J) 

K 

Observability matrix 
computed by 
OBSMAT. Dummy 
matrix in OBSMAT 
corresponding to 
OBSERV is V. 

filter 

OLROOT(I) 


Open loop poles 

CNTRL2 

OPTALF(I) 
1=1, N+l 


The real parts of 
coefficients 
ALFOPT, with order 
corrected. 

CNTRL2 

POLE (I) 
1=1, IR 


The common filter 
poles. R poles taken 
from an arbitrary 
list of N provided as 
input. 

FILTER 

POLES(I) 


The N poles available 
as common filter 
poles. 

FILTER 

ROW(I, 1) 


Dummy array used in 
ALPHAS. ROW is a 
column matrix, but 
is a row in ELINV. 

ALPHAS 

S(I, J) 

S 

The numerator trans- 
fer matrix. Succes- 
sive values of the 
matrix are computed 
as a part of computing 
ALPHA(I). 

CNTRL2 

ALPHAS 


5-39 

















F ortran 
Symbol 


SA(I, J) 


SAH( J, I) 
J = l, N 
1 = 1. M 


SCALE 


U(I,J) 


Mathematical 
Equivalent, 
if any 


h 1 . S. 



Definition 

Used in 

Dummy variable used 
in ALPHAS to 
replace S. 

ALPHAS 

Coefficients of open 
loop numerators 

FILTER 

A scale factor used 
in the library sub- 
routine SIMEQ. 

SYNTH 1 

Dummy array used 
by OBSMAT in 
determination of 
column independence. 

OBSMAT 


Temporary storage 
required by library 
subroutine SIMEQ. 


SYNTH1 



The columns are a 
series of unit vectors 
formed successively 
by OB S MAT in 
determination of 
column independence. 


OBSMAT 
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F ortran 
Symbol 


VK(I, J) 
1=1, N 
J = l, N+l 


VNXM(I, J) 
1=1, N 
J=l, M 


Mathematical 
Equivalent, 
if any 


(A*) 1 H 


Definition 


Used in 


A dummy matrix used FILTER 

to represent OBSERV 

and BAGSUM in the 

library subroutine 

MATS. 


Dummy matrix used OBSMAT 

successively in 

OBSMAT. 


The orthogonal vector OBSMAT 
computed by 
OBSMAT. Recom- 
puted successively. 
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CONTROL SYNTHESIS PROGRAM 2 


A-MATRIX 


-0.0322 

-0.0194 

1 , 0000 

-0.0211 

-0. 

-0. 

1,0000 

-0 . 

0.0693 

-0. 

-0, 

-0.4740 

-0. 

-0. 

-0 . 

-0. 

0.7620 

-0. 

-0 , 

-1760.5000 


ACTUATOR VECTOR (d) 

-0. 
- 0 . 
•0 , 
• 0 . 
17.5 


-0 ♦ 
- 0 . 
- 0 . 
1. 
-3 


PERFORMANCE MATRICES 
DRIFT MINIMUM 

0 . 1040E-02 
0 .6240E-03 
•0. 

0.«8n0E-03 

-0 . 


(C or CO 

0.6240E-03 -0. 

0.3750^-03 -0. 

-0. -o, 

0.4100E-03 -0, 

-0. "0, 


LOAD MINIMUM (c or Ct) 

0.1610E 01 -0, 

• 0 . - 0 . 

- 0 . - 0 . 

0.5600E 01 -0. 

- 0 ; - 0 . 


-0. 

-0. 


-0, 


-o . 
-0 . 


0.6800E-03 -0. 

0.4100E-03 -0. 

- 0 . - 0 . 

0.4450E-03 -0. 

* 0 . - 0 . 

0.5600E 01 *0 . 

*0. “0 . 

* 0 . - 0 . 

0.16106 01 -0. 

«0 , -0 . 


S-MATRICES OF OPEN LOOP 

option in Subroutine ALPHAS can print each S'^otri* as 
it is cowpaW . The mnatri*. m storage is then replaced 
with the ne*t watri* > etc 

INDEX* 4 ( 

COLUMNS 1 THRU 5 


0.3360E 01 -0.19406*01 

0 .1000E 

01 

-0 .21106-01 

*0. 

■0. 0.33926 01 

0.1000E 

01 

= 0. 

*0. 

0.6930E-01 -0. 

0.33926 

01 

*0 .4740E-00 

«0 . 

0. 0. 

0. 


0.3392E 01 

0.10006 01 

0.762OE 00 -0. 

-o. 


» 0 . 1 760 E 04 

0.32206-01 


0000 

3600 
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INCEX= 3 (SO 
COLUMNS 1 TH«U 5 


0.17606 04 
0 .69306-01 
0.2328E-00 
0.7620E 00 
- 0 . 


-0. 65186-01 
0.17616 04 
-0.13446-02 
- 0 . 

-0.1478E-01 


0.33416 01 
0.33926 01 
0.17616 04 
• 0 . 

0 . 762 0E 00 


-0.5449E 00 
=0.47406-00 
=0.16096 01 
0.38896-01 
=0.56706 02 


= 0 .2UOE-01 
= 0 . 

= 0 .4740E-00 
0 .32206-01 
=0 .6930E-01 


I NC Ex = 2 (Sj 

COLUMNS 1 THRU 5 


-0. 13506-12 
0 .232SE-00 
0.12186 03 
- 0 . 

-0 .11376-12 


-0.34156 02 
0.5647E 02 
-0 . 45176=02 
-0 .14786=01 
0 . 


0.17606 04 
0.1761E 04 
0. 56706 02 
0-76206 00 
-0 . 14786-01 


=0.15036 01 =0.47406-00 


=0.16096 01 
=0.56206-01 
=0.23156-00 
0.12166 03 


= 0 . 4740E-00 
= 0 . 16736-0 1 
= 0 . 69306-01 
0.13446-02 


1NCEX= 1 (S,) 

COLUMNS 1 THRU 5 


-0.1269E-09 
0.1216E 03 
-0 .93566-14 
-0.11376-12 
0.27916-12 


0.26736=14 
-0.1216E 03 
-0.23606 01 
0. 

0 . 1776E-14 


-0.3415E 02 
0-56706 02 
-0 . 12696*09 
-0 .14786-01 
-0. 21626-12 


0.3090E-01 0.9196E-02 


=0.56206-01 
0.55176-13 
0.45176-02 
=0.23606 01 


*0 . 16736-01 
0 . 5389E-13 
0.13446-02 
0.72436-10 


1NCEX= 0 (So) 
COLUMNS 1 THRU 5 


indicator 


of cowputat 


icm error 


0.30296-09 
-0.9356E-14 
-0. 87416-11 
0.2791E-12 
0.10256-09 


0.2463E=ll 
0.29866=09 
0 . 1 853E =15 
0.17766=14 
-0.39326=14 


-0 . 12696-09 
-0 . 12696-09 
0.29886-09 
- 0 - 21626 - 1 ? 
0.91306-12 


=0.37776-11 
0.5517E-13 
=0.85986-10 
=0.53336-09 
= 0 .31666-06 


0 . 4875E-13 
0.53896-13 
= 0 . 11366-12 
0.72436-10 
• 0 .36716-09 


The, veri^ small magnitudes of the 
elements of the S 0 matrix indicate 
the benefit of double precision 
arithmetic in “this subroutine. 


OPEN LOOP CHARACTERISTIC EQUATION 

COEFFICIENTS OF ASCENDING POWERS OF $ ( 0 TO 5) 

O.23590E 01 -0.121646 03 0.564736 02 0.17605E 04 0.33922E 01 

^ i.3<9 S 4 - nto.5 s* +• st.4-7 s* - lai 


ROOTS OF OPEN LOOP CHARACTERISTIC EQUATION 


REAL 

0 .19691E-01 

0.23625E-00 

-0.288156-00 

-0,168006 01 

-0.16800E 01 

7 SIGNIFICANT 


IMAGINARY 

0, 

0. 

0. 

0.419256 02 

■0.41925E 02 
FIGURES 


0.100006 01 

s +- 
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ELINV (LSED IN FILTER PROGRAM) 


0 . 160555E-00 
- 0 . 8276 0 4E 01 
-0 .368406E-00 
-0 . 

-0 . 


-0.2920196=00 
-0.827604E 01 
- 0 . 

-o. 

-0 . 


0 .940875E.12 
-0.292019E-00 
-0.827604E 01 
-0 . 

“0 * 


0 .234736E-01 
-0 1 120 996E 01 
0.562212E 00 
0.174600E 02 
-0 , 


0 . 126468E - 08 
0.234736E-01 
-0.120998E 01 
0.562212E 00 
Q.174600E 02 


Elinv = l 1 - u'S ( a, S a a 


Sn«]" 


TKiS mcdrt*. is computed each ttrvne but is used here . 

Vj itk <x list ot Itappa/s , tine computation avid printout 
done to tUs point iMould not be repeated - 


PERFORMANCE weighting factors 

DRIFT MINIMIZING (KAPPA-ROOF) -0. 

LOAD MINIMIZING < K A PP A - T I L DE ) 0.100E 06 


WEIGHTED PERFORMANCE index - c 
0 , 1610E 06 -0 . 

- 0 . - 0 . 

0 . 0 . 

0 . 56 n 0 E 06 -0. 

0 , 0 , 


0 , 0 .56006 06 0 , 

0 . =0 . o . 

0 , 0 . o , 

0 , 0 . 1610E 06 0 . 

0 . 0 . o . 


c 


>e C 


£ C 


SUBROUTINE POLYWG prints COEFFICIENTS OF EVEN POWERS OF S (ODD POWERS ARE ZERO), 
N ROOTS OF POLYNOMIAL FORMED BY EVEN COEFS, ONLY, N L,W.P t ROOTS OF 2NTH 
ORDER POLYNOMIAL, AND THE COEFFICIENTS GENERATED BY THE L.H.P, ROOTS. 


POWER OF S COEFFICIENT 


0 0.84655929E 04 

2 -0.22416455E Q8 

4 0.168914506 09 

6 -0.52179975E 00 

8 -0.35095707E 04 

10 • 0 . Q9999999E 01 


ROOTS FROM EVEN COEFFICIENTS 


0.3787315E-03 

0. 


0 , 1382508E-00 

0, 


0.3097846E 01 

0 , 


-0.1756404E 04 

0.7007595E 

04 

-0.17564Q4E 04 

-0 . 7007595E 

04 
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ROOTS WITH NEGATIVE REAL PARTS 


-0 .1946103E-01 
-0 . 37102O9E-OO 
-0.1760070E 01 
-O.5220745E 02 
-0.5228745E 02 


-0 . 

-0 . 

-0 . 

-0.6701030E 02 
0.6701030E 02 


COEFFICIENTS OF POLYNOMIAL GENERATED BY ROOTS IN LEFT HALF PLANE 


POWER OF S 


5 

4 

3 

2 

1 

0 


coefficient 

REAL 


0 , 0 9999999E 01 
0,10672624E 03 
0.74500308E 04 
0.15614923E 05 
0.50289Q33E 04 
0.92008653E 02 


IMAGINARY 

0 , 

- 0 . 

0, 15258789E'04 
-0.1Q967255E-04 
-0 . 18477440E-04 
-0 , 


CONTROLLABILITY MATRIX ( Actually 

0. 

- 0 . 

-0 .368406E-00 
-0.702633E 01 
0 . 672588E 03 


s transpose 

■ t D*) 



0, 


0 , 


'0 , 


-0 , 


0 . 


-0.I27604E 

01 

>0.8276046 

01 

0 « 27782 0E 

02 

0.277820E 

02 

0 « 14476 0E 

05 


0, 


0, 174600E 

02 

0.174600E 

02 

-0.586656E 

02 

0 .586656E 

02 

-0 .305412E 

05 

0.305412E 

05 

0 ♦ 205899E 

06 

0 , 20S899E 

06 

0.530760E 

08 


Tke, determinant of this matrix must be non -zero if "tUe system is to be controlled . it it were Zjero , 
an attempt would still be made to compete tUe control vector, but its terms would be ibe computational 
equivalent ot infinity. 


S-MATRICES OF CLOSED LOOP 


INDEX* a 

COLUMNS 1 THRU 5 


0.1067E 03 

-0 . 

0 . 6930E-01 
0 . 

0.3649E 04 


-D.194OE-01 
0.1067E 03 
-0 . 

0 . 

0.6909E 04 


0.1000E 01 
0.1000E 01 
0.1067E 03 
0. 

0.3229E 05 


= 0 . 2110E-0 1 

*0 f 

*0 .4740E-00 
0.1067E 03 
«0 . 7446E 04 


■0. 

-0. 

-o. 

0.1000E 01 
0. 3220E-01 


INDEX* 3 

COLUMNS 1 THRU 5 


0 .7446E 

04 

-0.2070E 

01 

0 .1067E 

03 

*0 . 2725E 

01 

•0 . 21 1 0E-01 

0 . 6930E- 

-01 

0.7450E 

04 

0.10676 

03 

=0.4740E- 

-00 

»o . 

0 .7394E 

01 

-0 . 1344E. 

'02 

0.74506 

04 

-0.50596 

02 

*0 . 47406-00 

0 .3649E 

04 

0.69096 

04 

0.32296 

05 

0.3366E 

01 

0.32206-01 

0 .2238E 

04 

0.1517E 

03 

0.11606 

05 

=0.1562E 

05 

-0 . 69306-01 
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INDEX* 2 

COLUMNS 1 THRU 5 

0.15316 05 -0.2902E 03 0*67636 04 =0,5056E 02 -0.47406-00 

0,73946 01 0. 15616 05 0.7450E 04 =0.5059E 02 =0.47406-00 

-0.1214E 04 -0.3275E 04 0.31606 03 =0.17846 01 -0.1*736-01 

0.22386 04 0.1517E 03 0-11606 05 =0.73936 01 =0.6930E*01 

0.47886 03 -0.5222E 03 0.15176 03 =0.50296 04 0.13446-02 


INDEX* 1 

COLUMNS 1 THRU 3 

0.3275E 04 -0.35726 04 -0.29Q2E 03 0.9811E 00 0.9196E-02 
-0.12146 04 0.1754E 04 0-31686 03 =0. 17846 01 -0. 1673E-01 
0-31836-11 -0.92016 02 -0-41846-09 =0.l345E-10 0.21556-12 

O.4780E 03 -0.5222E 03 0-15176 03 0.1434E-00 0-13446-02 

0.11796-06 -0.1 1 99E-06 0-26796-05 =0.92016 02 0.20146-08 


iNCfcX* 0 

COLUMNS 1 THRU 3 

0*78006-07 0.3103E-10 0-13536-09 0.98196-11 0.42196-13 

0.3183E-11 0.77956-07 -0.41046-09 -0.13456-10 0.2155E-12 

0.73696-09 0.4017E-09 0. 90346-07 0.52296-09 -0.38876-11 

0 . 1 1 79E-06 - 0 . 11 99E-06 0.2*796-05 -0.55286-07 0.20146-08 

-0.21696-05 0.15796-04 -0.10516-03 0.22006-04 -0.19106-06 


A-TILDE-TRANSPOSE (ATT USED IN FILTER PROGRAM) (A*) 


-0.3220006-01 

-0. 

0,6930006-01 

-0, 

0.3649366 04 

-0.194000E-01 

-0. 

-o, 

-0. 

0.690904E 04 

0.100000E 01 

0.1000006 01 

-o. 

-0, 

0.3228966 05 

-0.211000E-01 

-o. 

-0.4740006-00 

-0. 

-0.7446316 04 

-0. 

-o. 

-0. 

0.100000E 01 

-0.106694E 03 


OPTIMAL CLOSED-LOOP ROOTS 

REAL IMAGINARY 

-O.19461E-01 -0, 

-O.37102E-OO -0, 

-0.17601E 01 -0, 

-0.52267E 02 -0.67010E 02 

-0.52287E 02 0.67010E 02 



roots with negative, real parts . 
(or convenience . ) 


COMPUTED FEEDBACK CONTROL VECTOR (TERMS 1 THRU N) (<$) 

0.20897E 03 
0.39571E 03 
0.18493E 04 
-0.32565E 03 
-0.59184E 01 
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CLOSED LOOP ROOTS ACHIEVED BY CONTROL VECTOR 


-0.19461E-01 0, 

-0.37182E-00 0, 

-0.17601E 01 0, 

~0 * 52288E 02 0.67007E 02 

-0.52288E 02 -0.67007E 02 


T^cse roots shouli match the optimal 
closet) loop roots above. Qoundlotf 
error accounts tor the dliCt erences . 


5-47 



DESIGN FILTER TC APPROXIMATE CESIRED SYSTEM POLE CCNF I GURA T I CN 


A-TILDE-TRANSPOSE MATRIX ( a'*’ , £rom CM TGL2.) 


-C. 032200 

-0. 

0.0693C 0 

-0. 

3649. 359985 

-C.0194C0 

-0. 

-0. 

-0. 

6909.049988 

l.CCCCCO 

1.000000 

-0. 

-c. 

32289.699951 

-0.02 IICO 

-0. 

-0.4740CC 

-0. 

-744 6. 5CCOCO 

0. 

-0. 

-0. 

l.COOOCO 

-106.808999 


G-LilILt ICCNTRCL VECTOR) [^rorvi CMTfZL'L' 

200.969999 
395.709999 
1849. 3SS994 
-325.66CCOO 
-5.918000 


HSTAR matrix 


SE N SLR 

1 -0. 

1.000 

- rj . 

-0. 


-0. (Mewses <$0 

SE N SCR 

1 -0. 

-0. 

-C. 

1 .CCL 


-o . ( Senses fi) 

COEFFICIENTS cf 

CPFN LCCP CFARACTfck 1ST IC 

EQUATION (POWERS 

OF S FROM 0 TC M 





C.23598F 01 

-0. 12164E 03 

0.564 7 3E 02 

0. 1 7bC5E 04 


U.33922E U O.LOOOOF 01 

EL INV MATRIX 

( L” 1 yroin CNT(2.L2^ 







0. 16C5550E-C0 

-0.2920 19CE-C0 

0.940 SC COF-12 

0. 2347360 F- 

■01 

0. 1 264 700 L ; - OH 


-;.827604CF 01 

-0.82 7604CE 01 

-0.292C190E-CC 

-0. 1 2099 HOC 

0 l 

U. 2347360C-01 


, 36 0 4 060 8-0 0 

-0. 

-0 . 8 2 76 04 OF Cl 

0.5622120E 

0 0 

-0 . 1 2099 80 E 01 


0. 

-0. 

-C. 

0. 1 7 4 6 C 0 0 E 

02 

0. 5622120 E 00 


0. 

-0 . 

-0. 

-0. 


O.1746000E 02 
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CBSERVABILITY MATRIX 


-C. 

C.ICCCCOt Cl 
-C. 

-C. 

-c. 


’0. 

- 0 . 

- 0 . 

0 • 100000R 01 

- 0 . 


- 0 . 

- 0 . 

0-10CCC0E Cl 

0. 

c. 


- 0 . 

- 0 . 

> 0 . 

0. 

0. lOOCOOE 01 


0« 693000E-01 

0. 

0. 

-0.474000E-00 

- 0 . 


if formation of this matrix. IS possible , ( {be subroutine 005MAT checks Colu 
the system »s observable and a realisable Jitter can be derived. 


independence during formation) 
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kilter parameters 

'l - PORT f- ILTER 


POLYNOMIAL COt=P*R ICIfcN'TS In ASCENDING POWERS Of S (0 T(j 2 i 


NUMERATOR 1**0. 1 

U . 1 d / 1 6 0 V 0 . 8 6 8 1 E U 7 0 . 1 A 0 8 E 08 


NUMERATOR pO . 2 

0.474t>E 07 0.12366 08 0. 


c 0 M M o M denominator 
C . 8 U U HE iVi. O.feuOUF 01 0 . It CUE D 1 



filter roots 


NUMERATOR no. 1 


TKt single foot in Klume-rator Mo. \ 
is not computed or printed • 
COMMON DENOMINATOR 


-U , 30o2UUt-00 

U . 1944856-00 

-0. 3082006-00 

-L . 194465E-00 

is obtain able <A 

i recti trem une coelttcients abooe , U nee. 

- 0.2000006 in 

-0 . 

-u . AntuUUt Ji 

- 1 ' • 


RESULTING p GLF POSITIONS 
< 


-u . 1**61UR-G1 

IJ . 


-U ,3/lh2v6-0U 

3 . 


-U.1/6U09E 01 

u . 


L.4s6fc43E 0 2 

0.4885726 

0 2 

tJ.46fro*3E C2 

-0,4855726 

02 

-ii.S^28^8E 0 2 

0.6 /Oil OE 

02 


Ml poles eecept those added b<} the Otter should 
t>c in the same positions as 'T all variables 
had been measured. 

These poles should be near the Uter poles. 
The tact that the^ ore not , and that theij 
are unstable, md.cates that the ? liter 
poles should be chosen lurther Vrom the 
jU) a*, is. 


- 0.5228486 0 2 -0. 6701108 02 
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FILTER ^A’-tA^tTERS 


2 - PC* T F!lTr-R 

POLYNOMIAL COEFFICIENTS I N ASCENlINC PCwtRS C F S (0 TO 2 ) 


\UMrRATCR NO. 1 

C.9234R C 7 C.43 WE 08 0.M22E 08 

NUMERATOR nc. 2 

0 . 3 1 4 3fc Cfi -0.2794F ce 0. 


COMMON DENOMINATOR 
O.BCCOb 05 0.6COUE 03 O.IOOOR 01 



FILTER ROOTS 


NUMERATOR NC. 1 


-0 . 305 1 8 3E-00 C.l')lll4[-CC 

“0.30518 3 c— no -c.mn^-co 


COMMON RE'4CMNATCX 


-0.2CCC00E 03 -C. 

-O.AOQOOOE 03 -C. 


RESULTING POLE POSITIONS 


-0. 1S4610E-01 0. 
-O.J7178 IE-00 0. 
-0. 1 76C34E 01 0. 
-0.525566E 02 0. 
-Q.444U6E 03 0. 


these two poles are stable and nearer 
to tine filter poles t demonstrating the 
(XSi^mpticitij property ot the design proced 


-0.5228A2E 02 


0.670105F 02 


-0. 522642 E 02 


-0.670105E C2 




6. RESULTS OF COMPUTER FLIGHTS 


The control system synthesis and the simulated flights were 
accomplished for a five-dimensional model based on the rigid-body 
motions with perfect sensors and actuator. The equations of motion 
for this model are' 


a = -0. 0322a - 0. 01940 + 0-0. 0211(3 (6-1) 

0 = 0. 0693a - 0.474(3 (6-2) 

(3 = 0. 762a - 1760.5P-3.36(3 + 17.5 i|j (6-3) 

The two quantities, besides control, appearing in the criterion integrand 
are drift acceleration 


z 


T + T - D 
c 

m 


N T 

Ot r 

0 + a +— (3 = 

m m r 


q l 


x 


and bending load 


(6-4) 


L = 1.26a + 4. 4(3 = 


q 2 * 


X 


(6-5) 


For the flights, lateral drift was actually computed by integrating 


z = V (0 + a - a) . 
r w 


( 6 - 6 ) 


It will help the interpretation of the results of the simulated flights 
to review the design procedure very quickly. The control is of the form 

^ = g ‘ x = gj® + g z <P + g 3 0 + g 4 P + g 5 (3 , (6-7) 


^Numerical values were derived from NASA- supplied documents 
**See Section 3. 
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where the g^ are determined using the design programs so as to mini- 
mize the criterion integral 

+ «J, 2 \ dt , (6-8) 

10 7 / 

where k and k are weighting factors chosen by the designer. The fol- 
lowing restrictions should be kept in mind: (6-8) is minimum for initial 

condition errors in the absence of winds; because of the term 4; (required 
for stability) there is always some amount of drift minimization and load 
minimization called for, since ^ is a linear combination of all the states 
while drift and load are linear combinations of states, also. Because of 
the latter restriction, k and k are not directly related to the minimiza- 
tion of drift and load, respectively, in a straightforward manner. Indeed, 
the control can be written in the form 


C 

/ 


2 . ~ 


ii/=az + aLi + 4j l > 


(6-9) 


so that (6-8) becomes 


a 

f 


(k + a)z^ + 2aa'z'L, + ( — ^r-j + ajl^ + 2(az + aL.)^' + 4*' 

V 10 ' 


dt , (6-10) 


where a, a, and ijj' depend implicitly upon k and k. 

The optimal control design was carried out for a wide range of 
values of k and k. The resulting control systems were "flown" in the 
five-dimensional model of (6-1), (6-2), and (6-3) for various conditions, 
i. e., no wind and the wind shown in Figure 6-1, linear control (i|; = g • x) 
and bang-bang control (4 1 = s § n g ’ x )> small initial offset ( 0 - 0.1 , 

<p = 0.5°) and large initial offsets (a = 1°, <j> = 5°). Figures 6-2 through 
6-9 are typical of the computer output. The simulations were run on 
the IBM 7 094 of the Hughes Scientific Computing Department. The 

: 'Tn Figures 2-9 K1 = k and K2 = k. 
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program was coded in Fortran IV and employed a straightforward 
differential equation integration scheme available as a library sub- 
routine. 

One fact was evident from the computer traces - all the controllers 
exhibited the characteristics of "minimum drift control" in the sense of 
Reference 1; i. e. , "z goes to zero as soon as the transient oscillation 
around the center of gravity dies out. " *In fact, z goes to zero as soon as 
the wind velocity becomes constant. "Minimum drift" feedback gains in 
the sense of Reference 1 are never obtained, since all the states are fed 
t )ac k. Another fact is also easily deduced from the computer results — 
the drift performance is rather insensitive to k and k. Figure 6-10 
shows drift as a function of these quantities for linear control and small 
initial offsets (for the larger initial offsets just multiply by 5). Note 
that drift decreases slightly as k increases, as expected. For the runs 
with wind present, the differences in drift performance are not readable 
from the output plots; the common value for linear control and small 
offsets is 800 meters. It is also interesting that both linear and bang- 
bang control resulted in nearly identical drift performance for all the 
conditions investigated. 

The peak bending load is much more sensitive to parameter and 
control changes. Figure 6-11 shows peak load for the cases used for 
Figure 6-6. Note that L has a maximum between k = 0 and k = 10^. It 
is obvious from (6-10) that the criterion is more sensitive to a than k 
for small values of k; it is not surprising, then, that the peak load is not 

^Reference 1. E. D. Geissler, "Problems in Attitude Stabilization 
of Large Guided Missiles, " Aerospace Engineering , Oct. I960, p. 24. 
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i i i I n - i 1 1 r 

o. 2. 4. 6. 8. 10. 12. 14. 16. 

TIME 

Figure 6-2. Linear control (continued). 
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6 . 8 . 
TIME 


Figure 6-4. Linear control. 


DINE 







Figure 6-5. Bang-bang control (continued). 
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12 , 16 . 
TIME 


Figure 6-6. Linear control. 
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Figure 6-6. Linear control (continued). 
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1 1 
0 . 

1 

4. 

» l 

8. 12. 

I I i 

16. 20. 24. 

TIME 

1 
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32. 



Figure 6 -7. 

Bang-bang control. 
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12 . 16 . 

TIME 


Figure 6-8. Linear control. 
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a. 


i i 

4 . 8 . 


i i i i I I 

12 . _ 16 . 28 . 24 . 28 . 32 . 

TIME 


Figure 6-8. Linear control (continued). 
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Figure 6-10. Drift after ten seconds for initial 
offset of o = 0.1°, 0 = 0.5°. 
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Figure 6-11. Peak load for initial offsets of 
oc - 0.1% <j> = 0.5°, linear 
control. 


a monotonically decreasing function k, but is ultimately so. Since (6-5) 
shows that L is largely dependent upon (3, the peak load must depend 
upon the type of control chosen. For linear control in the absence of 
wind the peak load is linearly related to the initial offsets, while the 
peak load for bang-bang control is much less sensitive to initial condi- 
tions. However, after the initial response transients died out, the 
" long-term" (5-10 seconds) behavior of the bending load was reason- 
ably close for both controls. In the presence of wind, the situation is 
much more complicated (as Figures 6-2 through 6-9 show). The 
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peak load is now a function of initial offset, control, and wind pro- 
file. Since the available simulation time was severely limited, there is 
insufficient data on which to base any realistic conclusions about the 
load behavior in the presence of wind. 

The final series of flights consisted of a seven- dimensional model 
(including one bending mode) using the five- dimensional control vector 
discussed above for the case k = k = 0, including the effect of the wind. 


The equations used were 

a = -0. 0322a - 0. 01940 + 0 - 0. 0211(3 + a^ (6-11) 

0 = 0. 0693a - 0. 474(3 (6-12) 

'(3 = 0. 762 a - 1760. 5(3 - 3. 36(3 - 0. 0357£ + 17. 5 (6-13) 
t= 15.' 2(3 -0. 0036£, - 0. 006f, . (6-14) 


The performance of booster control system was not much affected by the 
inclusion of the bending term; the peak bending load was reduced some- 
what, and the drift was unaffected. 
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7. DISCUSSION AND SUGGESTIONS 


In Section 1 a 26-pole model of a large flexible vehicle was 
described. The model presented there can be used for extensions of 
the initial synthesis procedures described in Section 5, which were 
based on a 5- dimensional model, or for checking the stability and 
performance of closed loop systems for which the control law was 
derived for a lower dimensional model. It is felt that by adequately 
describing the dynamics of the vehicle, more reliable information about 
the stability of the actual vehicle may be obtained. In particular, the 
problem of blending sensor outputs so as to accurately identify the 
"state" of the system is intimately related to the existence of a com- 
plete model of the vehicle. This is an area of research which has 
recently received attention at Hughes Aircraft Company. 

We propose to couple an accurate model of the vehicle with Kalman 
filtering and the filtering technique of Hughes Aircraft Company described 
in Section 3 to synthesize a system which would be immune to the noise 
introduced by the sensors, be insensitive to the higher bending modes 
of the vehicle, and minimize a given performance index. Hughes 
Aircraft Company has recently obtained results along these lines which 
are presently being evaluated. 

The linear design procedure described in Section 5 may be 
extended to a higher dimensional model with little difficulty, but even 
for the existing procedure there are some areas of investigation which 
should be explored. First it should be determined how good the control 
law developed for a 5-dimensional model would perform when used for 
the 26-pole model. This has already been done for a 7-pole model. 

Also the possible improvement of performance gained by going from a 
5-dimensional model to a 26-dimensional model should be explored to 
see if the added complexity is justified when the disturbance is the worst 
wind. 

The nonlinear feedback law described in Section 4 seems to yield 
a minimax type of response when the system is subjected to an initial 
condition. This can be further checked by starting near the origin and 
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flooding the state space to determine actually how good the performance 
is. It should be noted that the number of products of state Variables 
increases factorially with the order of the model. It would, therefore, 
be worthwhile to investigate the performance of a high order system 
subjected to disturbances when the nonlinear control law has been 
designed for a low order plant. There is good reason to believe that 
the resulting system will be stable since feedback, in general, com- 
pensates for ignorance about the actual plant dynamics. 

In the area of stability of closed loop system the results of Sec- 


tions 3 and 4 indicate that the control laws d 


~ivcd there are globally 


asymptotically stable when there is no actuator saturation. For systems 
where there is actuator saturation the resulting systems are still stable 
in a well-defined, computable neighborhood or the origin. The results 
along these lines are presented in Appendices C and E. However, the 
stability results derived so far relate only to initial conditions and not 
to continuously acting disturbances. In order to determine the actual 
behavior of a working system it is necessary to obtain analytical results 
which will allow one to say exactly in what region the system is operat- 
ing. This requires using the concept of "practical stability" as defined 
by Lasalle and Lefschetz to get an accurate assessment of the behavior 
of the system for "worst" input disturbances. In the case of linear 
systems bounds are easily obtained and, in fact, were presented in 
Hughes Aircraft Company's original technical proposal. However, in 
the case of nonlinear controlled systems or linearly controlled systems 
for which the control law was derived for a lower order model, these 
bounds are not easily obtained and further work is necessary to get an 
accurate assessment of behavior of the system. This would correspond 
to completing the study of the performance index 


min || x 


where one takes the maximum overall allowable disturbances. 
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| Thus we conclude that this study has yielded some very useful 
control laws for linear models of the vehicle when one considers initial 
condition disturbances, but also there should be further study to assess 
their usefulness when applied to linear plants acted upon by "worst" 
disturbances. / 
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APPENDIX A 


LINEAR CANONICAL FORMS FOR CONTROLLABLE SYSTEMS 
INTRODUCTION 

In this paper four different coordinate systems are studied, 

namely 

1) state variables (x) 

2) phase coordinates (0) 

3) Lur'e coordinates (£) 

4) generalized Lur'e coordinates (<j)) 

There are six nonsingular linear transformations, namely 

4> = T0 

x = D<j> = DT0 
£ = V*x = V*D4> = V*DT0 

that relate the four coordinate systems. In order to pass freely among 
these coordinate systems, including the inverse transformations, a 
total of twelve matrices must be utilized. 

In particular numerical applications wherein the dimension n of 
the state space is large, it is desirable to avoid either inversion of 
n x n matrices, or complete spectral analyses of (nonsymmetric) 
matrices. The present analysis achieves this by explicit presentation 
in "closed form" of rational expressions for the elements of all twelve 
matrices . 

It has been shown by Lur'e Cl], Letov [2], and many others, 
that use of Lur'e coordinates facilitates explicit construction of 
Liapunov functions [3], hence facilitates study of stability of equilibri - 
um in dynamical systems. 

More recently it has been shown by Bass, Lewis, and Mendelson 
[4], [5], by Wonham and Johnson [6], [7], [8], by Kalman [ 9 ], and by 
Bass and Gura [10] that use of phase coordinates facilitates the appli- 
cation of frequency-domain concepts to various problems of system 
stabilization and optimization stated in time -domain concepts. 
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In this paper a system of generalized Lur'e coordinates is 
defined. Unlike the Lur'e coordinates, these variables are well- 
defined regardless of whether or not the system's "open-loop poles" 
(eigenvalues, characteristic roots) are distinct. Although many 
realistic engineering problems do not have multiple roots, many highly 
illuminating examples of modern control theory can be derived readily 
when multiple roots are permitted. Therefore the complete generality 
of applicability of this last-mentioned coordinate system is important 
for both exposition and research on advanced control problems. 

The system to be studied is of the type 

x = Ax + aiji 0 


where 


x = Ax 

governs the evolution in time of the uncontrolled system, where "a" 
is the actuator vector , and where the scalar ijj = ^(x) denotes the 
feedback control law . (In this paper the functional nature of 
irrelevant, hence unspecified. ) 

The characteristic polynomial of the uncontrolled system is 
defined by 

n 

A(s) = det (si - A) = ^ a^s 1 , 

i=0 

which defines the coefficients ol , a , , • • • , a a __ = 1* Similarly, 

o 1 n - 1 n 

matrices S,, S~, • • • , S are defined either by 
1 2 n 

n 

S. = y a .A^ _1 , ( i = 1, 2, • • • , n) , 

i 2L j 

j =i 
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or by means of the resolvent equation 


i - 1 

— , g 

A(s)p * 

In numerical practice, use of the preceding definitions for the 
o', and S i is quite impossible for large values of n, since it would 
require n! multiplications. However, an efficient recursive algorithm 
stated below permits their computation in about n 4 multiplications. 

The given system is called controllable [9] if the system of n 
simultaneous linear equations 

a • b = 0 , Aa • b = 0 , • • • , A ^ ' 1 a • b = 0 , •••, 

A n_2 a -b = 0 , A n_1 a-b = 1 , 

has a unique vector b i 0 for its solution. The vector b can be com- 
puted by Gaussian elimination. In general, computing b represents 
(1/n)— of the arithmetic labor required to invert an n X n matrix. 

The vector b is important for several reasons. In particular, 
it is the normal vector at x = 0 to the time -optimal switching surface 
of the given control problem. In fact, it can be proved [ll], [12] that 
the time -optimal regulator law has the form 

= s g n [b * x + P Q ( X )] . 

where {p^(x)/ || x || } -> 0 as ||x || -»• 0; in fact for some e >0 there are 

positive constants p , ri such that 

o 1 o 

1 +Tj 

Ip o (*>I 5 pJM ’1 0 > 0 , ( l|x I s 'j) . 

Furthermore, if the phase variable 6^ is defined by 

0 j = b ‘x , 


(si - a ) -1 = y 
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then it will be shown below that the given system is equivalent to the 
scalar system of n ^ order defined by 

A (^) 6 l = +0 • 


Passage from the phase variables 0 0^, * * * > 0^/dt , ’ ' ’ > 

d n " 1 e i /dt n_1 to the state variables x^ • • • , x n is facilitated by the 

result 


n 

V" 

x= z 

i=l 


d 1_1 0. 


dt 


i-1 


S.a 

1 


to be proved below. 

Next, assume distinct roots, i. e. assume that the complex 
numbers ' ' * > satisfy 

A(V) = 0 , A'(\) t 0 , (i = 1, 2, * • • , n) . 


Define vectors v 1 as suitably normalized eigenvectors of A' 1 ', namely, 


A* v* = Vv 1 , v 1 • a = 1 , (i - 1 , 2, ♦ • • , n) 


Then the Lur'e coordinates of x are given by 


= v 1 • x , (i = 1, 2, • • * , n) ; 

it is easy to see that these variables satisfy the system 

£. = V£. + di , (i = 1 , 2, • • • , n) . 
*i in T o 
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Furthermore, it will be proved that return from the variables £. to 

*i 

the x. is provided by the transformation 


n 



i=l 


where the vectors u are defined as suitably normalized eigenvectors of 
A, namely 


a i > i 12 n 

Au - U , u + u + * • • + u = ( 1 , 1 , • • • , 1 )* 

The preceding definitions of the u 1 and v 1 are adequate in principle but 
in practice are inconvenient. However, the correctly normalized u* 
and v can be computed efficiently by the following closed form 
expressions : 


■‘-2 

j=i 

n 

V 1 = ^ (V) j_ 1 s*b , (i = 1, 2, • • • ,n) . 

i= 1 

A complete summary of results, in systematic tabular form, 
are given at the end of this appendix. All of these formulas are used 
in the authors' theory of integrals and isochrones [ 1 1 ] which allows 
explicit (local) solution in closed ("algebroid") form of both the time- 
optimal regulator problem [12] and the bang -bang control problem 
with quadratic performance index [ 13] . 


<v 


J-l 


A' (\) 


S j a ’ 


(i - 1, 2, • • • , n) , 
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NATIONAL CONVENTIONS 


a. Matrices are upper case letters. 

b. Vectors are lower case unsubscripted or superscripted 
letters. 

c. Scalars are subscripted lower case letters. 

d. Exceptions to these rules are i, j, k, 1, v, n which are used 
as summation indices or scalars; s which is a complex 
scalar; A(s) which is a polynomial in s; and t which denotes 
time . 

e. Asterisks used as superscripts (*) denote matrix 
transposition. 

f. The i th column of the identity matrix is represented by e\ 

g. The symbol ~ denotes equality by definition. 

ALGEBRAIC PRELIMINARIES 

In general, the solution of the system of differential equations 

x = Ax + adi (1) 

T o 

At 

involves the transition matrix e , whose Laplace transform is the 
resolvent matrix (si - A) where I is the identity matrix and s is a 
scalar. It can be shown [4, 14] that this matrix is given by 


(si - A) 


r(s) 

A(s) 


( 2 ) 


whe re 


n n 

A(s) = det(sl - A) = c^s-* > r(s) = ^ s , 

j=0 i= 1 


( 3 ) 
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and the , S^, • • • , and the a , * • * , are effectively computable 
by the recursion relations 


= 1 , 
n ’ 

S = I 
n 


(4a) 

' . = - \ tr (AS . , ) , 

n-J j n-j+1 ' ’ 

(j = 1,2, 

‘ , n) , 

(4b) 

1 . = a .1 + AS . . , 

n-j n-j n-j+1 ’ 

(j = 1, 2. • 

• • , n) , 

(4c) 


The matrices S i can be shown [4] to satisfy 
n 

S n-j = X a i Al " n+J (j = 1,2, ••• ,n) . (4d) 

i=n-j 

The theoretical definitions (3) and (4d) cannot be used to compute the a. 
and for large n, as they involve n! multiplications. However, the 
algorithm (4b-c) requires only about n 4 multiplications and has an 
intrinsic self-checking feature in that (by Cayley -Hamilton) S q = 0. 

The controllability criterion of Kalman [9] is fundamental to the 
present analysis and will be assumed henceforth. For the system (1) it 
can be expressed in determinantal form as 

det D 4 0 ( 5 a) 

where 

1 

D = (a, Aa, • • • , A " a) . (5b) 

Theorem 1 

If the matrix L is defined implicitly by 

L' 1 k (S ia ,S 2 a, •••,S n a)* (6) 
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then 


L = [b, A*b, (A-) 2 b, • • • , (A-) n_1 b] (7) 

where the vector b is given by the solution (e. g.,by Gaussian elimination) 
of the nonsingular system of linear equations 

D*b = e 11 


Proof , If the above hypothesis is to be identically true, it must be 
shown that 


[(S 1 a,S 2 a,---,S n a)*]-‘e i = (aV'H , (i = 1, 2, - - - , n) (9a) 


or, equivalently, that 


... , . a. , i - 1 . 


= (S ia ,S 2 a, •••,S n a) : ' s (A ; ‘ i ) ‘b , 


(i = 1, 2, • * • , n) (9b) 


is valid. In particular, the rows of (9b) can be written as 


n 


a* Sr (A*) 1 l b = a* S a (A*) v- ^ +1 " 1 b = 6.. , (i, j = 1 , 2, • • • , n) (10) 

1 /—i v 1J 


V=j 


Now replace summation over v by summation over k where k - v+ i j, 
and obtain 


n+i-j 

k=i 


k+ j - i 


.(A :; ') k-1 b 


= 6 .. 
ij 


(ID 


as the relationship to be established. 

Consider first the case for which j > i. This implies that 1 < k < n 
Note that (8) can be written explicitly as 


5. = a*(A*) k_1 b , (k = 1 , 2 , • • • ,n) 

kn 


( 12 ) 
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where 5 is the Kronecker delta. With this, the left side of (11) 
becomes o^j i^kn * The summan d is zero except when k = n 

(which requires i = j) in which case the sum takes the value <? = 1. 

Hence (11) is true for j > i. 

Returning to (11) when j < i, write the left side of that equation as 


n 


n-j+i 




k=i 


k= n+ 1 


( 13 ) 


Now, by the same argument used above, the first summation in (13) 
yields the value Q ' n+ j - On replacing k by m=k + j -i, the second sum 
becomes 


n 


a*A 1- ^ -1 Y a- (A*) 

m 

m=n+l+j-i 


m 


b = -a* A 


a. A i - i - 1 


n+j-i 


2 v (A *> 


m. 


b , (14) 


m=0 


where the latter result was obtained by use of the Cayley-Hamilton 
Theorem. (A matrix satisfies its own characteristic equation.) Now since 
j < i, (12) can be used (with m instead of k) and the second sum equals 


n+j-i n+j-i 

-t a a*(A*) m+i -j- 1 b= -S a 6 

/. m A m : 

m=0 m=0 


m+i-j, n 


( 15 ) 


This has the value zero except when m+ i - j = n in which case it becomes 
.. Combining this result with that following (13), it is seen that 
for j < i the left side of (11) is zero. Thus relationship (11) has been 
proven and theorem must be valid. 
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Theorem 2 


A more concise expression for the inverse of L is 


where 


rp _ rp A 


(L _1 f = DT 


a & 

1 2 


a _ a „ 

2 3 


O' , 1 

n-1 


1 0 


a 


n-1 

1 


0 0 
0 0 


( 16 ) 


(17) 


th 

Proof . By inspection, the i“* column of T can be written as 


n 


i j-i+1 

t = y a. e J 


( 18 ) 


J =1 


Now by definition 


DT = (Dt 1 , Dt 2 , • • • , Dt n ) 


(19) 


where 


n 


Dt‘ - I “j 


D 


J-i+1 


J=i 



( 20 ) 


But by (4), the definition of S^, Dt 1 = S^a. Then applying (6) yields 

DT = (L -1 )* = (Sja, S 2 a, • • • , S n a) (21) 

as desired. 
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Theorem 3 


A pair of explicit expressions for the inverse of D is 


D' 1 A ( a , Aa, • • • , A n_1 a ) ” 1 = TL* 

(22a) 

D _1 = (S*b, S*b, • • • ,S*b)* 
i c n 

(22b) 

Proof. Consider the matrix 


LT* = LT = (Lt 1 , Lt 2 , ■ • • , Lt n ) 

(23) 


By (18) and the definition of L, 

n 

Lt 1 = ^ [b, A*b, • • • (A*) n ~ 1 b]a’. e j ~ i+1 

j=i 


n 

= *b , (i = 1, 2, • * • , n) (24) 

j =i 

Applying (4d) it is seen that Lt 1 = STb. Thus, 

LT* = (S*b,S*b,-- • ,S*b) (25) 

Now by Theorem 2, D _1 = [(L" 1 )*T" 1 ] _1 = TL* , or LT* = (D~V so that 
by (25) 

D” 1 = (S* b, S* b, • • • , S* b)* (26) 

as required. 
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Theorem 4 


An explicit expression for the inverse of T is 


0 0 
0 0 


0 1 

1 P 


1 


0 

1 


^n-3 ^n-2 

P n-2 


(27) 


where the (3 1 s are given by the following recursion formula 


Po = 1 • 


.-1 


P v a j+n-vPj ’ (v= 

j=0 


(28a) 


(28b) 


Proof . The proof of this theorem consists of two parts. The first 

part introduces the appropriate set of quantities ((3.) which obey (28). The 

- 1 1 

second part shows that T is given by the matrix displayed in (27). 

Part A . Define the quantities (3 j ( j — 1 , 2, • • • ) by the Laurent series 


y Ji- 

A(s) ZL n+j ’ 
1=0 


( s > max s^ | ) 


where the s. are the roots of A(s). Then 

l 


1 



(29) 


(30) 
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Replace j by use of the definition v = j + n - i, obtaining 


n oo 

1 = 2 I “iPi + v-„ S " V < 31 > 

i=0 v=n-i 


Now interchange the order of summation by observing that 0<n-i<v<co 
and 0 < i < n imply that 0 < v < co and max (n - v , 0) < i < n. Thus 


= 2 

v=0 


n 

I 

i=max(n-v , 0) 


a A 3. 

i r 1 + v-n 


- v 


(32) 


Note that the very first term on the right side of (32) is the only constant 
in the series. Thus for (32) to be valid for all |s | > max |s.j that term 
must be equal to unity and the remaining terms must all be zero. Then 


a 1 3-1 
n r o 


(33a) 


n 


I 


<2.(3. =0 

11 + v-n 


(v = 1,2, 


, n) 


i=n - v 


(33b) 


n 

^ Q ' i ( 3 i+v _ n = 0 , (v = n+1, n+2, n+3, • • ' ) , (33c) 

i=0 

or equivalently, p = 1, 


n-1 


v - 1 


P v = - 1 “i P i t v-n= - I« j+ n-v p j • 
i=n-v j=0 

where j = i + v - n, and, similarly, 

k+n-1 

p k+„ = - 2 "j-kpj - <k 
j=k 


(v = 1, 2, • • * , n) , (34a) 


= 1 , 2 ,**-,) , 


(34b) 


where k = v-n. 
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Part B. It will be shown that TT * = I, where T * is defined by 

th 1 

{21). By inspection, the j — column of T is given by 

m 

tJ = ^ (3 k eI1+k ' j+1 (35) 

k=0 

Then, using (18), the i-j- element of TT -1 = T*T _1 = (T^r 1 , • • • , T*t“) 
is 

n j - i 

1 ‘' tJ = 1 ^VkVi+l.n+k-j+l (36) 

£ = i k=0 

The non -zero terms of this expression occur only when l -i+l=n+k-j+l 
or when i = n+k-j + i. However, i < t < n and 0 < k < j - 1 must also be 
satisfied. This implies that i s n-f k - j+i < n or that 0 < k < j - i. Then 
(36) becomes 


J-i 


- J -i' 


(3 

n+k-j+i k 


k=0 


(37) 


For j = i this reduces to unity. Forj^iletv=j-i and, using (34a) , 
obtain 


■ j =i« 


n+k- v K k 


p t = -p. 


+ 6 - 0 

V 


k=0 


(38) 


and the theorem is proven. 

PHASE VARIABLES (0) 

> k 1 

Taking the scalar product of (A ;,<: ) b, (k = 1 , 2, ' * • , n) , with the 
system (1) results in 

{A*) k_1 b~]= (A*) k_1 b-Ax + (A-) k_1 b-a4> 0 . (39) 
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Applying (12) gives 


[(A*) k_ 


1 dx 

b ' dF| = 


(A v ) d • x + 


6. ^ . 

kn o 


(40) 


Now define a new variable 


0 i = b • x 


(41) 


where b satisfies (8). Then for k= 1, (40) becomes 


, dx d0 l * 

b ’ dF = FdT^ A w 


(42) 


Differentiating this expression with respect to time and using (40) for 
k = 2 gives 


dV 


dt 


= A' b 


!r = < A > b 


X 


(43) 


Continuing in this manner obtain 


and 


Then 


d 1 " l e 


dt 


i- 1 


- = (A‘ ) X X b • x (i = 1, 2, • • • , n) 


d e 


dt 


- 1 = (A*) n b-x+ 

n ' ' o 


” d^0 

/ o' - — = [a- I + a . A‘ + • • • + a (A" ) n ]b • x + Jj . 

^ J dt J 1 n ° 


j=0 


(44a) 


(44b) 


(45) 
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Now by the Cayley- Hamilton Theorem A (A' 1 ) = 0, whence 

n d j 0 

y — r = A (d/dt)e, = 

^ J dt J 10 


j=0 


Upon defining the state variables 0 0 ‘ by 


d 1 " 1 © 


0. 


i " - i- 1 ’ 

dt 


(i = 1, 2, • • ■ , n), 


( 46 ) 


(47) 


the n^ 1 order scalar differential equation (46) can be expressed as the 
first order matrix system 


n 


0 = C0 + e > 


(48a) 


where 


0 - 


1 

CD 

i 


1 

O 

i 

0 

. . . 

0 

O 

i 

6 Z 


0 

0 

1 

■ . . 

0 

0 

. 


. 

• 

• 


• 

• 

« 

O 

ii 

• 

• 

• 

. . . 

• 

• 

* 


• 

• 

• 

• • • 

» 

• 

0 

n 


• 0 

0 

0 

• • • 

0 

i — 1 


0 
$ 

1 

~ a \ 

~ a 2 

• • • 

1 

Q 

b 

i 

IN) 

ij 


(48b) 


To find the transformation matrix between the x and the 0 coordi- 
nates, note that Equation (44a) can be expressed as 


0 i = (A' ) 1- ^b • x , (i = 1, 2, • • • , n) , 


(49a) 
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or 


0 = [b, A*b, • V , (A* ) n " l b] X = if X (49b) 

Note that applying this directly to (1) and comparing the result with (48) 
shows that 


C=LA(L*) -1 (50) 

By Theorems 1 and 2 the inverse of (49b) can be established directly. 
Thus 


n 

X = -(L*f 1 e - (Sja, S 2 a, • • • , S n a)e = ^ O.S.a (51a) 

i= 1 


or 

x = DT0 


11 GENERALIZED” LUR'E VARIABLES (cj>) 

(The reason for this name will become clear in a later section. ) 

Relations Between x and 4> 

Let 

<j> = D _1 x (52) 


Then (1) becomes 


1 


1 


4> = (D AD)«|> + D ai); 


(53) 
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Consider now the matrix product 


0 0 0 


0 -a. 


1 0 0 


0 - O', 


0 1 0 


0 -a. 


DC = (a, Aa, • • • , A n " 1 a) 


0 0 0 


n- 1 


= (Aa, A^a, • • * , - ^ o\ A*a) 


i=0 


1 -a 


n- 1 


(54) 


Applying the Cayley-Hamilton Theorem, the last column of (54) becomes 
A n a whence 


DC* = AD 


(55a) 


or 


D" *AD = C* 


(55b) 


Note also that, by Theorem 3, 


D" *a 


(Sjb, S ^b, • • • , S*bfa 


or, using Equation (10), 


a * S ^b 


i ‘ 

a- s 2 b 


0 

• 


• 

• 


• 

• 


• 

a - S b 


0 

n 





1 

e 


(56a) 


(56b) 
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Thus (53) can be expressed as 


<j> = C <f> + e iJj 


(57) 


The forward and reverse transformation relations can be expressed 
explicitly as follows. By (52) and Theorem 3, 


= D" J x = Tl/'x = (S*b, S*b, • • • , S*b)* x , 


(58a) 


or 


<t> i = (S.b) • x , (i = 1, 2, • • • , n) 


(58b) 


Also 


n 


x = D<|> — (a, Aa, • • • , A n_ 1 a)^> = <(>. A 1 " l < 


i= 1 


Relations Between 0 and^ 


Previously [(58a) and (51b)] it has been established that 


(59) 


4> = D" 1 x , x = DT9 


( 60 ) 


Consequently, 


4> = T0 


( 61 ) 


In particular, using (18) 


n 


4* = (t 1 , t 2 . * ■ • , t n )e = ^ t'e. = ^ ^ a. e-* 1+ 1 9 . , 

i--i 1 i= 1 j=i J 


n n 


( 62 ) 
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and so 


4> 

v 


<|r e v 


n n 


y y a.e . & . . , 

L* j i v, j-i+l 

i= 1 j =i 


(v = 1, 2, • • - ,n) . (63) 


Non-zero terms occur in (63) only when v - j - i + 1 or when j = v + i - 1. 
Combining this with the constraints 1 < i < n and i < j < n, j can be 
replaced by v + i - 1 only ifl<i<n-v + l. Then 


4> 

v 


n- v + 1 

S a e. 

/ i v+i- 1 i 


i= 1 


(64) 


whence, setting l = v+i - 1 


n 




i e (-v+l ’ <v=l, 2, , 


l-v 


4 > = 0 , 

n 1 


(65a) 

(65b) 


The inverse transformation can be established in a similar 
manner. Employing (3 5), 


n 


n i- 1 


= T 'V e ” = 2 T V' V = 2 2 Mi 


n+k-i+1 v 

e • e 


i= 1 
n i- 1 


i= 1 k= 0 


= 2 zL (3 k 4> i 6 v, 


n+k- i+ 1 


i=l k— 0 


This expression can be simplified to 


( 66 ) 


n 


0v = 


2 ^v-n+i- l^i 


i= n - v + 1 


(67) 
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by considerations similar to those used after (63). Finally, if summation 
over i is replaced by summation over I = v - n+ i - 1, there results 


v- 1 


0 


* I ^ 


v r f T £+n-v+l , (v = 1, 2, • • • , n) , 

i = 0 


0 1 = *n 


(68a) 

(68b) 


LUR'E COORDINATES (£) 

Relations Between | an d 

By inspection of Equations (54) and (57), the system (1) is precisely 
equivalent to 


*1 = ’V^n + ^o ’ (69a) 

4> z - 4>i - a^ n , (69b) 

= *j_i " (j = 3, • • • , n). (69c) 

Now consider the 4> coordinates for a system with distinct complex 
eigenvalues (i= 1, 2, • • • , n). Multiply the j — equation in (69) by 
and sum to obtain 

n n- 1 n- 1 

S X i" S = 2 " 2 "j^n + ^o * (i = 1, 2, • • • , n) (70) 

j =1 j=l j=0 

Now since 

n-1 

A(\.) = 0 , - V a .\i = a \ n , 

1 ZZ jin’ 

j=0 
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and (70) reduces to 


II H 

y d - v = y y<t>.+ 4* , 

Z-, 1 J Zj 1 J O 


(i = 1, 2, • ' • , n) 


Define 


j=l 

as the component of an n-vector £ . Then (7 1) becomes 


4- " X.g. + , (i = 1, 2, • • * , n) 

m mi o 


or, in vector form, 


i + u T 


wh ere 


A = (\ 1 e 1 , X 2 e 2 , • • * A n e n ) , u° = ( 1, 1, • • * , if ( 

The transformation (72) between £ and 4> can be expressed in 
matrix form by the equation 

| = Z ' <fc> 

where Z = (z 1 , z 2 , * * • , z U ) and where 


(V; ) k ” 1 e k , (i = 1, 2, • • • , n) . 
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7s!i \ " 1 


To find (Z*) consider the following. The identity 

Cz = \.z , (i = 1, 2, • • • , n) 


( 76 ) 


can be verified by inspection of (48b). Now by (55b), Theorem 3, and 
(50), 


Hence 


T _1 C*T = T” 1 D _ J ADT = L*A(L -1 )* = C. 


T~ 1 C*Tz 1 = X.z 1 
1 


(77) 


(78) 


or 


C^Tz 1 = X.Tz 1 


(79) 


If the (i= 1, 2, • • • , n), are distinct, then A'(\.) = [d(A(s))/ds]. 4 0 

and so 1 


C 


* Tz 1 _ . Tz 1 
” a / 


A'(\.) - A'(\.) • 


Now define the vectors 

W 1 = Tz i /A'(\.) , (i= 1, 2,---,n) 

Then from (80), 

C^w 1 = Juw 1 , (i = 1, 2, • • • , n) . 

Using (76) and (81) it is clear that 


(80) 


(81a) 


(8 1b) 


w J • Cz 1 = \.w J • z 1 , (i, j = 1, 2, • • • , n) , 


(8 2a) 


and 


z 1 • C*w^ = XjZ 1 • w-* , (i, j = 1, 2, • • • , n) . 


(8 2b) 
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Hence 


V(z^*w^) = X.(z^*w^) 
i J 

which implies that 

z i • = 0 , i t j • 


For i = j, note that 


i i 
z * w 


i 

z * 


Tz 1 
A' (\) 


( 83 ) 


(84) 


(85) 


By (75) and ( 18 ) 


n 


n n 


5 i -Tz i = ^(V) k - 1 z i .t k = ^(V k_1 - k+1 • (86) 


k=l 


k=l i =k 


Hence 


n ,k-l n 

(\) 


n n \ \j£ - 1 


”.<V 


*.w‘= y y«,x‘- k = y y - ax_ 
4 <v 4 1 4 4 * ^ 


(87) 


To reverse the order of summation in the last expression note that 
1 < k < l < n implie s 1 < ■ L < n and 1 < k < l . Thus (87) become s , 
for (i - 1 , 2, • • ■ , n) , 


; i. w i = y y V4l‘ = y !V44 = , . 

£-> A' (X ) ^ A' (X.) 

1 = 1 k=l i 1 = 1 i 


( 88 ) 


Combining (84) and (88), there results w *z = 6.^ or equivalently 


• 1 2 n , 1 2 n \ t 

(w , W , ' • • , W )'■ (z , z , * * * , z ) = I 


(89) 
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A , 1 Z 


If w = (w A , w“, ' • ' , w n ), then (89) becomes 


W = (Z*)' 1 


( 90 ) 


Hence (74) implies 


$ = , (91) 

To express this relationship more explicitly note that, as in (8 6), 


«.= we = y w 4 e. = f g. 

ZL 1 Li A' (\ ) 


i= 1 


A' (\.) 
i=l 1 


n n . .k-1 n 

= y y y « e £ - k+ y 

zL Z, a' (\ ) L i e h ’ 

i= 1 k= 1 i t =k 


(92) 


or 



n n 


I 2 


(\ i ) k ~ 1 JL 

A'(\ ) Z a t ^i 6 j, f -k+1 

i i =k 


(93) 


The summations are trivial except when t = j + k - 1. Combining this 
with the constraints k < i < n, 1 < k < n, (93) reduces to 


n n-j+1 ^ jk- 1 


vl 


i.i ' ( H> 


or, setting v = j + k - 1 , 


n 


vZ 


i= 1 


A, A'(\ ) v 
v=j 1 


a 


^ > (j = 1, 2,---,n) 


(94) 


(95) 
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Relations Between i and 6 


By (91) and ( 6 1 ) it is obvious that 


= T - 1 W£ 


( 96 ) 


In particular, from (92) 


n 


n n (X.) k -* 


. y -si. i. = y y e k 5 . , 

A'(\.) 1 A'(\ ) 1 


4- i 


A'(\.) 


(97) 


or 


8 j ' S A'Ol ) 
i= 1 i 


(j = 1, 2, • ♦ ' , n) . 


(98) 


Similarly, the inverse transformation is easily established from (74) 
and (61) to be 


I = z*Te . 


(99) 


Hence, proceeding as usual, 


n 


n n 


*i = 2* i - t V I 5\y‘- ek ‘ J+l 

j=l j= 1 k=j 


n 


=i 

j=i 


n 


ivr j 

u=j 


e. , (i = 1, 2, , n) . (100) 

j 
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Relations Between £ and x 


The basic relationship between £ and x can be found immediately 
by applying (58b) to (72). Thus 

n 

h = ]£ X i" ls jb*x (101) 

j=l 

^ 1 2 

Now define V = (v , v , * * * , v 11 ), where 


i 


v = 



(i= 1, 2, • • • , n) 


Then 



(i = 1, 2, ---.n) 


or 


( 102 ) 


(103a) 


t =V*x (103b) 

Alternatively, combining (58a) and (74) gives, by Theorem 3, 


£ = Z*TL*x , (104) 

so that 

V* = Z*TL* (105) 

must be valid. By Theorem 2 and (90) 

(V*)' 1 = (L*)“ 1 T -1 (Z*)“ 1 = DW (106) 
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For convenience define 


it A , i Z 
u = (u , u , 


n \ - 
U ) - 


DW 


where, as in (9Z), 


u 


Dw 


n . J-l n 

. 0^)_ 

~ A'(X.) 

J=1 i k=J 


. A k J a = > — S.a 

k ^A'(\.) 1 

j=l 1 


( 107 ) 


Then 


x = DW£ = U£ 



(108) 


Extensions and Generalizations 
The identity 

h, n 

A(ri)-A(|J.) = (n-M-) ^ h 1 " 1 /L 1 ( 109 ) 

i= 1 j=i J 


can easily be verified by equating coefficients of like powers of r\ and p 
where these quantities obey the commutative and distributive laws of 
algebra. With no loss of generality, rj can be identified with si and \x 
with the matrix A. Then 

n n 

A( s)I - A(A) = ( si - A) J s 1 ' 1 ^ a A 3 ~ l (110) 

i=l j=i J 


and, by the Cayley-Hamilton Theorem and the definition of T (s), 

A(s)I = (sI-A)r(s) (111) 
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Indeed, (Z) can be found directly from this relationship whenever 

(si -A) exists. By multiplying (111) on the right by the vector a it is 

also clear that 


A(s)a = sT (s)a - AT (s)a 
Before proceeding, define the vector u(s) by 


u(s) a 


A(s) 


( 112 ) 


(113) 


where 


Mb) 


A(s) for A(s) 4 0 

A'(X.) for A(s) = A(\ i ) = 0 and X^X. (i, j = 1 , 2, • • • , n) . 


Explicitly-, 


u(s) 


n n 

= 2 2 


J-i 


n 


j-i 


j=l k= j Ms) 


*' " = 2 2 t 1 - « k A k - j a 


k=l j=l A(s) 


(114) 


Now let £ = k - j + 1 and replace j to obtain 


u(s) 


2 2 « 

k= 1 1 = 1 


k Mb) 


(115) 


Taking the scalar product of u(s) with the vector b and applying (12) it is 
clear that 


u(s)* b 



k=l 



k-i 


a 


k A(s) 


■ n 


1 

£(s) 


( 116 ) 
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Returning to (112), note that u(s) satisfies 


A(s)a + Au(s) = su(s) , A(s) 4 0 (117a) 


where 


u(s) ^ A(s)u(s) = T(s)a 


(117b) 


and so, dividing by A' (X .) and setting s = X.., there results 


Au(X.) - X.u(X.) , 


A 


X. 4 x (i, j = 1 , 2 , • • • ,n) 

(117c) 


u(x i ) ’ b= Wl 


{117 d) 


In the latter case, the u(X.) reduce exactly to the u 1 defined in (107). 
Thus the columns of U are merely the eigenvectors of A, normalized 
according to (117d). Consider (109) again with ti as si and A* as [i. 
As before, it can be shown that 


A(s)I= sr*(s) - A*T(s) (118a) 

or 

A(s)b + A* T* (s)b = sr*(s) (118b) 

Define 

v(s)^r*(s)b (119a) 

or, equivalently, 


v(s) = I s ^ . (119b) 

j=i J 
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Proceeding in a manner analogous to that followed in Equations (114) - 
(116), it is clear that 


v(s) • a = 1 


( 120 ) 


Also, by (118b) 


A(s)b + A*v(s) = sv(s) (121) 

is always satisfied. When A(s) = A(X .) = 0, (i = 1 , 2, • • • , n) , (121) 
becomes 


A * v( x .) = X.v(X.) , 

(i = 1,2,. 

• • , n) , 

(122a) 

II 

✓C 

> 

(i =1,2,- 

* • , n) . 

(122b) 


By comparing (119b) and (122) with (102), it is obvious that v(\ .) is 
identical to v , (i = 1 , 2, • • • , n) , and that these vectors are the eigen- 
vectors of A* normalized according to (122b). 

Note that (10 3a) can now be generalized, using (119b) and (58b), to 

n 

iAs) = v(s) -x = 2, s 1_1 4>. . (123) 

i=l 

Then, taking the scalar product of v(s) with the system (1) and applying 
(120) and (121) it is found that 

v(s) • x = v(s) . (Ax) + v(s) • 

= x*A*v(s) + i(j o (124) 

= x*(sv(s) - A(s)b) + ib 

o 
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Now using (123) and (49a), the above becomes 

4 0 (s) = s£ o (s) - A(s)e i + , e i =b.x = 4> n (125) 

This can be considered a generalization of the Lur'e canonical form. 

In fact, when the eigenvalues of A are distinct, 

= i o ( X .) , (i = 1, 2, • •• ,n) , (126) 

and, setting s = X . in (125), the Lur'e form (75a) is recovered. On the 
other hand, whether or not the X. are distinct, the identity (125), which 
in form is highly reminiscent of the Lur'e form, can be regarded as 
the collection of n differential equations obtained by equating like powers 
of s on the right and left hand sides. However, on inserting (123) into 
(125) and comparing coefficients, the canonical form (69) (or, equiva- 
lently (57)) is recovered immediately. It is for this reason that the 
form (57), which is valid whether or not the X^ are distinct, was called 
the "Generalized Lur'e Canonical Form. " 

In a subsequent paper [ 1 1 ] , an explicit, analytic, non- singular , 
nonlinear transformation 


o- = g(<t>) = g(TL*x) , (127) 

will be defined which transforms the Generalized Lur'e Form (57), for 
constant , into the simplest possible canonical form, namely 

ar = m e 11 . (128) 

T o 

The use of (57) in the form (125), which is valid whether or not the X ^ 
are distinct, is the key to a very direct proof of the important result 
(128). 
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SUMMARY 


A. Major Definitions and Identities 

For the system x = Ax + aijj Q , in general: 


(si - A) 


-1 = F(s) 
A(s) 


A(s) = det(sl - A) = s 11 + a s n 1 + • . 

n- 1 


+ a =0 
o 


n 


F(s) = ^ s i_1 S. , 


i= 1 


n 


S i = S a j AJ_1 ’ (i = °> l > 


• • • , n) , S = 0 , 


J=i 


n-1 


D = (a, Aa, • • • , A a) , det D i 0 , 
D*b = e 11 , 

L = (b, A*b, • • • , (A*) n-1 b) , 

L, ^ = (S^a, S^a, • • • , S^a)* , 


n 


(A ” 1 )* = DT , 


-1 


D * = TL* = (S*b,S*b, • • • , S*b)* , 


n 


T = <i= 1, 2,- • - 


J=1 


T _1 = (T^T 2 , ...,T n ) ; t 1 = £ p. e 

j=0 


i-1 


n+j-i+2 


(i = If 2/ * • , n), 
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V- 

■ 1 


K'l 

-\ 

a 

j 

(3. , 

j+n-v j 

j = 

0 




n 1 

C= (- 

a 

o 

e , e ~ a \ 



n 


a . 
J- 

•1 e > ’ * * * e 

f 1 = C 

i 



n 


j-i 


- 


D _1 AD = C* . 


For n roots V of A(s) = 0 distinct: 


n 


Z = (z 1 , z 2 , * * * , z n ) , z 1 = ^ (V) 


k-1 k 
e 


k=l 


W 


= (w 1 , w 2 , • • • , w n ) , w 1 = Tz'/A'fV) 


v {K i )j_1 V 
= Z A'(\.) Z a k 

j=l 1 k=j 


k-j+1 


W = (Z v ) 


* V " 1 


n 


V = (v 1 , v 2 , • • * , v n ) , v* = ^ ^Tb , 


j=l 


n (V)j - 1 


U = (u 1 , u 2 , ' • • , u n ) , u 1 = Dw 1 = 

j=l 1 


U = (V*)' 1 , D*V = Z , 


Au 1 = X-na 1 , u* • b = 1 / A'(A.^) , (i - 1 , 2, • • * . n) , 
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D. Canonical Forms in Vector-Matrix Notation 

x = Ax + aip o , 

0 = C0 + e n dj , 

r O 

cj) = C' ,4 <J> + e , 

T o 

£ = A £ + u °^ 0 ’ ( u ° ” e e^+* • • + e 11 ) . 

E. Canonical Forms in Vector-Scalar Notation 

A(d/dt)0 1 = vJj q , 0 1 = J 

n 

i 0 (s) = sC o (s) + 4 j o - A( s) cj) n , ys) = ^ s 1 - 1 * 

i=l 

i = \.£. + , £. = U\.) , 

i ii i o r 

for all distinct, (i = 1 , 2, ■ • * , n) . 
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APPENDIX B 

. . A NONLINEAR CANONICAL FORM FOR CONTROLLABLE 

BANG-BANG SYSTEMS 

SUMMARY 

Consider the state- vector control system x = Ax + ae , t = ±1, 

where the pair (A, a) satisfies the condition of controllability. It is 

known from general existence therorems [2], [3] that there exists near 

x = 0, a nonlinear non-singular coordinate transformation c r = p(x, e ) 

such that the given system is equivalent to the simplest possible system, 
• n n m 

cr = e e , e = (0, 0, ' ' ' , 0, 1) , whose state-space trajectories are 

parallel straight lines. Here the function p(x, e ), and its inverse 
Mcr.e), where g = p[h(<r, e ) , e ], are defined explicitly by closed-form 
expressions involving only rational functions and the elementary trans- 
cendental functions. Various problems of stabilization and optimization 
can be solved in the cr- coordinates and the answers then applied to the 
original system in x-coordinates. In many cases [8], [9] it is possible 
to define scalar functions g{x) and 4>(cr) such that the desired control law 
is given in the form € = sgh {4<[p(x, ?)] }, ? = sgn[5f(x)] which is readily 
mechanizable by means of the explicit representation for p(x, t) 

INTRODUCTION 

In a previous paper [i] several linear coordinate transformations 
were defined such that useful canonical forms of the system differen- 
tial equations can be easily obtained. 

Here a nonlinear coordinate transformation is defined which 
changes any controllable linear bang-bang system into the simplest 
possible system, namely one whose state-space phase portrait consists 
of parallel straight lines. Evolution of the system in time then corre- 
sponds to uniform rectilinear motion. 

The theory of integrals and isochrones [2], [3] will be reviewed 
in a general setting. Then for controllable linear systems a complete 
set of integrals and isochrones will be given by means of contour inte- 
grals in the complex s-plane [Equation (40)]. Alternate expressions 
suitable for use in computer-algorithms will be derived using Lur'e 
coordinates [Equation (45)], generalized Lur'e coordinates [Equations 
(66) and (67)], and phase coordinates [Equation (84)]. Because of the 
usefulness of these integrals and isochrones in designing and simulating 
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optimal control systems, the algebraic and analytic details of their 
construction will be presented in full. It is assumed that the reader 
is somewhat familiar with the results of [l]. 


NOTATIONAL CONVENTIONS 

a. Matrices are upper case Roman letters. 

b. Vectors are lower case unsubscripted or superscripted 
Roman letters. 

c. Scalars are Greek letters and all subscripted lower ease 
letters. 

d. Exceptions to these rules are as follows: 

1) i, j, k, 1, v, m, n are used as summation indices or 
s calars . 

Z) 0, (f), £, o- (unsubscripted) are vectors. 

3) s is a complex scalar. 

4) A(s) is a scalar polynomial in s; r(s) is a matrix 
polynomial in s . 

5) t is a scalar denoting time. 

e. Asterisks used as superscripts ( ) denote matrix transposition. 

f. The i th column of the identity matrix is represented by e . 

g. The symbol 4 denotes equality by definition;the symbol E 
denotes identity. 

DEFINITIONS AND INTERPRETATION 

th. 

A first integral of the n order system 

x = f(x) , x(0) = x° , (1) 

is a scalar function a\,,(x) such that 

o\,.[x(t)] = cr,,, (x° ) ( 2 ) 


B-Z 


is satisfied along any solution of (1). Alternatively, <r.,,(x) can be de- 
fined by the condition 

f(x) • grad o\,,(x) = 0 . (3) 

The equivalence between (2) and (3) follows directly from the identity 

do\,Jx(t)] 

— = x(t) • grad <rjx(t)] = f(x). grad cr >;; (x) | x = x(t) . (4) 

Geometrically, (2) defines an integral surface such that any state- space 
trajectory initiating on it, must remain on it for all t . Henceforth, 
the term "integral" will be used interchangeably for the function o\,,(x) 
and the surface o\, ; (x) = constant. The meaning should be clear from 
the context. 

An isochrone is a surface defined by setting the scalar function 

c t (x) = constant where <r (x) satisfies 
o o 

0" o [x(t)] = <r o (x°) + t (5) 

along any solution of (1). Note that, as in (2) - (3), the condition (5) 
is equivalent to 

f(x) • grad cr o (x) = 1 . (6) 

For a geometric interpretation, assume that two trajectories of (1) 
start on the same isochrone. Let the initial condition be x° for one, 
and x° for the other. Then 

%( x °) = %< x °> • ( 7 ) 

At some time t assume that the first trajectory crosses another iso- 
chrone defined by cr o [x(t)]. Let t represent the time at which the 
second trajectory crosses this isochrone. Then by definition 

"^Clearly, it is only necessary that (3) hold identically on the single surface 
= cr ; ,,(x°); however, if (3) holds in a neighborhood of x°, then there 
exists a family of integral surfaces o\, ; (x) = constant in that neighborhood. 
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( 8 ) 


<r Q [x(t)] = <r Q [x (t)] . 

The characteristic property of an isochrone is such that (8) must imply 

t = t. (9) 

Thus the time for points on various trajectories to move between fixed 
isochrones is constant;hence the term "isochrone. " In subsequent work 
this term will refer to either the function o- q (x) or the surface 
cr (x) = constant. 

O .A 

A regular point x is one such that f(x) 4 0 . A singular point x, 
which is such that f(x) = 0, provides an equilibrium solution x(t) = x 

of (1). 

GENERAL THEORY OF INTEGRALS AND ISOCHRONES 

Theorem 1 . If o^, cr^, • • • , o' n _ 1 are integrals for (1), then so is 

o\,.(x) = £,(<3^, cr 2 , •••, <r n _ 1 ) , ( 10 ) 

where £ is an arbitrary function of its n-1 arguments. 

Proof. By composite differentiation, (10) yields 

n- 1 

f(x) • grad <r., ; (x) = ^ [f(x) • grad ou] = 0 . (11) 

j=l j 

Theorem 2. Every integral cr ; ,,(x) can be expressed in the form (10) 
in a neighborhood of a regular point x if cr ^ , cr^, • • • , o’ n _ 1 are function- 
ally independent at that point [i. e. , the vectors grad cr^> (i = 1» 2, • • • , 
n-1), evaluated at x, are linearly independent]. 

Proof . If the n-vectors grad cn,(i =1, 2, • • ♦ , n-1), are linearly 
independent at x, then the matrix 
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3 cr 

9x, 


3 O'- 

3 x. 


3 cr 


n-1 


3 x , 


8^ 

3 x~ 


3 cr- 
3 x. 


3 cr 


n-1 


3 x- 


( 12 ) 


3 cr, 


3 x 


n-1 


3 cr- 


3 x 


n-1 


» x 


n-1 

n-1 


(S) 


must be non- singular . [Note that since the x T s can be arranged arbi- 
trarily, can be chosen with no loss of generality as that variable 

3 cr v 


for which the vector 


f 3 cr^ 3 cr^ 

i3x * 3x * 
V n n 


n-1 


3 x 


is linearly dependent 


n 


on the rows of (12)]. Then by the Implicit Function Theorem [see 
Appendix l] the transformation 


% = Pi< x l’ x 2’ x n-l’ X n ] ’ 


(i = 1. 2, * • * , n-1) (13) 


has a unique inverse 


X k h k^l’ <r 2’ °n-l’ x n ) ’ 


(k = 1. 2, • , n-1) (14) 


in a neighborhood of x. 

Or, in that neighborhood, 


a i = <r 2’ 


cr , , x ), 
n-1 n 


h n-l^l’ °2’ 


Vl’ X n>’ X J- (15) 
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Since (15) is an identity, ou must be independent of x^; hence 

' n - 1 


3 cr . 


3 x 




n 


V _^i 

Zj 3x. 


3 Pi 3h k ^ + 3p. 


k=l 


- 3 x 

k n 


3 x 


n 


, (i= 1 , • ' • , n) 


Now consider an arbitrary integral 


= Uxj. x 2 , •••, x n-1 , x n ). 


Applying (i4), 


cr* = p*[h 1 (cr 1 , cr 2 , 
and so 


• %-i> - 11 r 


••‘ r n-l’ x n kx nl 


dc 


dx 


n 


^n- 1 

i 

k=l 


1L 9h k \ 

9 x, 3 x I 3 x 
k n / n 


Before proceeding, note that the definition of an integral requires that 

f (x ) * grad o\, c E 0 , f(x). grad o\ EE 0 , (i=l, 2, • • • , n-1) , 

or, in vector-matrix form, 

[grad o-j, grad (r 2 , • • • , grad cr n _ 1 , grad cr*] f(x) = 0 . 

Since f(x) 4 0, this can only be valid if, at x, 

n-1 

grad <r^ = y. grad cr. , 

i= 1 

where the y^ are constants not all zero. In scalar notation, (21) is 


( 16 ) 


(17) 


(18) 


(19) 


(20a) 

(20b) 


( 21 ) 
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n-1 

9 x. 2i 3x, ' 
k i=l k 


ai 


(k=l, 2, • • • , n). 


( 22 ) 


With this, (19) becomes 


d°\ t< 

(y 

n-1 a 

y v 8p i 

8 M 

1 

/ y 

dx | 

n 

(k=i 

Z 3x, 

i=l k 

dx n) 

T 



9 P; 


n , 


(23) 


or, rearranging the summations, 
n-1 


dcr.,. 


uu J, 

Z ^i 

n , , 


k=l 


9 p • 3 h. 

\ r i k 

3 x. 


i= 1 


, 3 x 

k n 


9p i 
3 x 

n 


(24) 


By (16), then, 


dcr.,. 


dx 


0 , 


n 


(25) 


which indicates that or.,, is not a function of x . Thus the construction 

n 

(18) has defined a function C such that 


<r., ; = (o-j, cr 2 > 

and the proof of the theorem is complete. 


+ 




(26) 


Theorem 3 . Let o\,„ be an integral, and or^ an isochrone. Then the 


function 

is an isochrone. 


cr = c Tj, + cr 
o * n 


(27) 


t A theorem similar to Theorem 2 is given in [4, p. 115]. However, that 
theorem refers to n independent time-varying integrals; in [4], if or 
is an isochrone, (<r - t) is called an integral. Theorem 2 is not a 

direct corollary of [4, p. 115], 
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Proof. Since 


f(x) • grad <r = f(x) • grad o*^ + f(x) - grad °' n = 0 + 1 = 1 , (28) 

(27) must be an isochrone. 


Theorem 4. Let cr be an isochrone, and let ( r , & } • • 
n Y c 

first integrals, functionally independent at a regular point x. 
every isochrone cr can be expressed in the form 

+cr n 

in a neighborhood of a point x for an appropriate function ?> . 


cr t be 

n- 1 

Then 


(29) 


Proof . By hypothesis, 


f(x) • grad o- q = 1, f(x) * gradcr^zz: 1 (30) 

whence 

f(x) • grad (<t q - cr^ = 0 , (31) 

and cr - o' 4 c r, must be an integral. In a neighborhood of x Theorem 
on-* 

2 applies, and c must have the form (10). Thus every isochrone must 
have the form (29) in that neighborhood. 
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RELATIONSHIP TO CONTROL THEORY 


The value of the concepts introduced in the preceding pages to the 
theory of automatic controls is embodied in the following theorem* 

Theor em 5 . If cr ^(x; € ) , cr ^(x; t) , • • • , q-^ ^ (x; e ) are first integral s 
and €o* n (x; e) is an isochrone for the system 

2 

x = Ax + ae , (« = I) , (32) 

and if the elements of the vector o- = [(r^x; 6 ), u 2 (x; e), • • . , £( r n (x;«)] 

are functionally independent at x, then in a neighborhood of x there 
exists a unique transformation <r = p(x; «), and inverse x = h(cr; e) between 
the system (32) and the system 

6- = ee 11 , (33) 

where p and h are n-vector functions and € is a parameter only taking 
on the values +1 or -1. (The reason for making e a factor in the defini- 
tion of the isochrone will become evident later. ) 

Proof . By the definitions of integrals and isochrones, or. = 0, 

(i = n_ 1) and to* n = L or o* = e , whence (32) implies (33). How- 
ever, by the Implicit Function Theorem [ see Appendix 1 ] , the implicit 

equation cr - p(x, e) = 0 has a unique solution x = h(cr;e) near x, because 
the Jacobian matrix 3(cr - p)^/3Xj = -9p./3Xj is non-singular at x by 
hypothesis. 

Geometrically, the nonlinear change of coordinates described 
above rectifies the state- space flow of (32) into the most elementary 
possible dynamical system, namely uniform rectilinear motion along 
parallel straight lines. Solution of the system (33) is, of course, trivial. 

APPLICATION TO HAMILTON- JACOBI EQUATION 

If the transformation between (32) and (33) (i. e. , between x and u 
coordinates) can be found explicitly, solution of the Hamilton- Jacobi 
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partial differential equation encountered in optimal control theory is 
facilitated. 

Consider the problem of choosing the control € in (33) such that 
the cost functional (or performance index ) 

A 

$(x°) = J SI'(x) dt (34) 

o 

is minimized. Here x(t) = x^ is a given stopping condition so that the 
terminal time = t^x 0 ). The optimal control e = e(x) then is given 
by the solution of the Hamilton- Jacobi Equation [6], [7] 

min jx-A* grad <£>(x) + € a* grad $(x) + ^(x)j = 0 . (35) 

When a* grad <£ ^ 0, this expression is minimized by the choice 

e = -sgn[a*grad $(x)] , (36a) 

and so (35) becomes 

x • A* grad <$(x) - | a • grad 3?(x)| + T'(x) = 0 . (36b) 

Now, when Theorem 5 applies, Equation (36) may be transformed from 
x-coordinate s to cr- coordinate s by setting 

$(x) = <£> [H ( cr ; € )] ^ 3>(cr;e) , (37a) 

tf(x) = ^[h(cr; e)] 4 $(cr; e) . (37b) 

Correspondingly, the pair (A, a) becomes (0, e 11 ), and so the Hamilton- 
Jacobi Equation (36) becomes 


€ 8$((r;e) 
9cr n 



€ 


-sgn 


/s 

9 % 


(38) 
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For constant e, the general solution of (38) is 

« 

cr 

$(cr; e) = $ q (c r j, cr * ' ' > o" n _ yC.) - c.j tNcr, e) dcr n , (39) 

o 

where $ o (cj-j, cr^, ' * ' » cr^^e) is an arbitrary function. In fact, 

9$/9<r n = 0, whence (39) obviously satisfies (38). Thus (39) is a par- 
ticular solution of (39). On the other hand, the difference between any 

two particular solutions of (38) must be a solution of dZ/dcr , which is 

/\ ^ 

fully accounted for by the arbitrariness of in (39). 

Thus if the transformation laws x = h(o-; e) and cr = p(x; c) are 
known, an important class of optimal control problems can be reduced 
explicitly to the problem of properly piecing together functions of the 
type (39). 

EXPLICIT CLOSED-FORM TRANSFORMATION FROM x TO r 

Theorem 6. The system (32) is equivalent to (33) under the trans- 
formation defined by 


£ q (s) = v(s)- x 


(40a) 


^ = Z^T 1 f 7 lo § l 1 + €S £ 0 (s) ] ds ’ (j = 1, 2, • • • , n) 

" 1 | S I=P /A 


(40b) 


where ||x|j is sufficiently small so that |s£ o (s)| < 1, and the path of 
integration is a circle enclosing all the roots of A(s) = A(\.) = 0, 

(p > max|M| ). (Recall that the quantities v(s) and A(s) are defined in 

in [1]. ) 
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Proof . Differentiate (40b) with respect to time and apply 
[ 1 , ( I25)]"t” to obtain 

/ j-1 

s T — — — € —7 — r [s£ (s) + £ - A(s)0 .1 ds , (41a) 

A(s) l + es| (s) I V 1] 

M P 


or 


£ r l €s e 0 ( s ) + gZ ] ds i_ / s3 " le i ds 

r j ” 2 ttnT-1 J A(s) 1 + €s£ (s) " 2W-1 J l + fc s£ Q (s) 

|S| = P |S| = P 


(41b) 


Now, since € = ±1, the first term of the right side of (4lb) becomes 


IttV-I f 


J-1 


2ttnT-1 J ^ s > " J n 

|s| = P 


= €6. , (j = 1, 2, * ' * , n) . 


(42) 


The derivation of this result is given in Appendix 2. The remaining 

term on the right hand side of (41b) can be expressed as 


■At/ t 

|s| = p 


J-1 


+ e 


s £ 0 (s) 


| s | -P ( k= 0 ) 


ds = 0 


(43) 


if | ep| (p)| = | p^ Q (p)| < 1. (In fact, since the integrand in (43) is ana- 
lytic in s, Cauchy' s Theorem implies that the integral in (43) is identi- 
cally zero. ) Combining (42) and (43) with (41b) yields 


a- = S jn , (j = 1, 2, • • • , n) , 


(44a) 


or, in vector notation, the desired system equation 


cr - £ e 


n 


(44b) 


must be valid. Note that the condition |p£ 0 (p)| < 1 can be obtained as a 

constraint on llxll by applying (40a) to obtain ||x|| < ' — T“ where v is 

p v(p) 

the upper bound of ||v(s) || on |s| = p . 

t[i, (125)] refers to Reference [l], Equation (125). 


B- 1 2 


Corollary 6. 1 . For distinct X., (i = 1, 2, •••, n ), it is clear that 

integration of (40b) by the Calculus of Residues yields the closed-form 
expressions 

e^v'-x, v 1 = v (\.) , (i= 1, 2, n) . (45a) 

Y (x i )J_1 ( 6 ) 

°"j ~ a'(X.) lx - l0g f 1 + e x i^i^ ’ (j = 1. 2, • • • , n) , (45b) 

i=l 1 1 i > 

where £. are simply the components of the state vector in Lur 1 e canoni- 
cal form [ 1] . 

In cases for which the system eigenvalues are non-distinct, the 
explicit evaluation of a is not as simple as in (45). For convenience, 
define 


h ( s » € ) = log [ 1 + esf.(s)l 

S 


(46) 


Then (42) becomes 


0-. = — i- £> 

J 1 J 


i 0 ,6 ) 

~~Ms) 


ds . 


|S|=p 


Assume that A(s) - 0 has i < n distinct roots X. such that X. i 
multiplicity j. , that is, 


(47) 


s a root of 


A(s) = (s - K j) J 1 (s - \ J Z ■ ■ • 


<s-V , 


wh 


ere 


j l + j 2 + *** Jm = n 


(48) 


(49) 


Then by a partial fraction expansion in (47), [5], 
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i J i 


"j = / 2 2 


IV 


j.-V + l 


ds , 


|sl = P i i= 1 v= 1 (s - X ) 


(50) 


where l is the number of distinct roots of A(s) - 0 and 


,v-l 


k. 


iv " (v - 1)1 | dg v-l 


Ji 


(S - X.) X T|( S, £ q , € ) 


A(s) 


- \ 


(51) 


The theory of complex integration then yields the following result. 

Corollary 6. 2 . For non-distinct X. , the transformation (40) has 
the closed-form expression 


cr . = 
J 



(j = 1, 2, • * * , n) . (52) 


EXPLICIT CLOSED-FORM TRANSFORMATION FROM o TO x 

Theorem 7. Assume that the system (32) is controllable. The 
transformation cr = p(x, €) has a unique inverse x = h(cr, t) given by 



r 

n n-v 


x- 1 <£ 6 < 

exp 

V V 1 1+1 

£ Z Z^ s a 

- 1 

2tt V- 1 f s 

|s|=P 1 

l i 

"1 

o 

n 

r— | 

II 

_l 

V 


(53) 


where u(s) is defined in [1]. 

Corollary 7. 1. When the X^ are distinct, the inverse of (45) is 
given by 


n i 

r 

n 

n-v 


X 

n 

M 

H m 

exp 


V \ ^ +1 

> Oi , K . c T 

/ V+i 1 V 

- 1 

i=l 1 1 

( 

v= 1 

0 

1 



( 54 ) 
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Proof of Theorem 7 and Corollary 7. 1. The simplest proof of 
Theorem 7 seems to be that in which Corollary 7. 1 is proved first, 
independently, and then used as a lemma in the establishment of the 
theorem. In other words, (54) will be proved and then generalized to 
(53); subsequently, (54) can be recovered as a special case of (53). 

Consider (45) and define a vector q such that each component is 
given by 


*1 = 


A' (X.) 


x: lo s : 


+ . £ . 
i l 


(i = 1, 2, 


n) 


(55) 


Then (45) can be expressed in vector-matrix form as 

cr = Zq , (56) 

where Z is the Vandermonde Matrix. 

As shown in [ 1 ], the inverse of Z is given by the transpose of a 
12 n 

matrix W = (w , w , * ■ • , w ) such that 


. " (X.)j- 1 " 

w = Zj a 1 (X.) Aj a k e ^ ’ (i = 1» 2, • • • , n) , (57) 

j=l 1 k=j 


where the are the coefficients of the characteristic polynomial A(s) 
of the system. Thus (56) yields 


q = WV , 


(58a) 


or 


q. = w • <r 
n 


(i = 1, 2, • • • , n) 


(58b) 


Then, combining this with (5) gives 


£i = — exp 
i ' 


c X.. A’(K.) w 1, cr 
x 1 


- 1 


(59) 
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Now, applying (57), 


n n 


n n 


ex.A^x.jw'-o- = e J 2 a k x i ek ‘ J+1 ' cr = 6 S E ft k x k.j+r a - (60) 

j=l k=j j=l k= J 

To transform this last formula to a more convenient form, replace 
kbya new index v = k - j +1 and obtain 


n n-j + 1 

< w ‘- " = 2 2 "v+j- f-i % 

j=l V=1 


(6i) 


Interchanging the order of summation in (6l) and letting I - j - 1, 

n n-v 

ek.AHk.) w 1 .<r= J 2 a v+i X i +1(r v ‘ 
v= 1 1=0 


(62) 


Then, applying this result and [ 1,(108)] to (59), it is clear that the 
desired transformation formula is 


n n | 

[ 

n n-v 

) 

x= Ih u ‘ = It: 

exp 

•2 

-* 

i= 1 i= 1 | 


v = 1 1=0 

) 


(63) 


Now define a transformation x = h(cr, O by (53). Using the Calculus 
of Residues, it is clear that (63) is equivalent to (53) when the y are 
distinct. Also, for distinct y» (45) and (40) are equivalent. Hence it 
is certain that (53) is the inverse of (40), at least when the are dis- 
tinct. It will now be shown that this proposition is valid for all systems , 

even when the are non-distinct. To verify this, consider (40b) in the 
i 

cr = p(x; e , A, a, ) , (64) 


and define A to be simple when the roots of its characteristic polynomial 
A(s) are distinct. It is well known that if A is not simple there are 
simple matrices such that jjA-A^jj is arbitrarily small. 
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It has been shown that there exists a function h(<r;e,A, a), namely 
(53), such that 

h(p(x;e, A,a);€, A v )) 4 h(x; € , A, a) = x (65) 

is valid whenever A is simple. Now take A non- simple. Let jA y J be a 
sequence such that A v is simple for each v = 1, 2, 3, • • • and such that 
A v~* A as v — co. Now the integrand in (40b) is a continuous function of 
x. A, a, and e since v(s) is a polynomial in A, a, and 1/A(s) [l, (119b)]. 
Recall also that 1/A(s) is an infinite series in powers of s - ^, which 
converges for |s| > maxfXp, whose coefficients are rational functions 
of A. Thus p(x;e , A, a) is a continuous function of all its arguments. 
Clearly, an analogous result can be obtained for h(<r;e,A, a). Thus 

A 

h(x,e,A,a) is continuous in all arguments and so h(x;e , A , a)— h(xx , A, a) 
as v ► oo . But since h(x;e , A v , a) = x, it follows upon taken the limit that 
h(x;€ , A, a) = x. This completes the proof of the theorem. 
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EXPANSION OF a IN SERIES OF 
RECURSIVELY COMPUTABLE MULTINOMIALS 


Theorem 8. The functions cr^ defined in (40) may be expressed as 


<T . = 
1 


co 


a = 0 


(i = 1, 2, • • • , n) 


( 66 ) 


where the sequence of numbers j j is recursively computable from 
the definitions 






a 


j+n-i 



(i = 1, 2, * • * , n) 


(67a) 


P 


i+n 


i+n-1 

2 Oj-fV ( ' = 

j=i 


(67b) 


and where the functions co v = w v (x) are multinomials of degree v in 0^, 
02 » * * * > 0 n > also recursively computable by 


W 1 = 0 1 


(68a) 


v-1 




= 0 - — > m co 0 , (v ~ 2, 

r v w Z-* m r v -m ' 


, n) 


(68b) 


m=l 


n 


co 


v+n v+n 


S ^^W+n-i • 


i= 1 


(v = 1, 2, • • • ) , 

( i = 1, 2, • • • , n) 


(68c) 


and the 0^ 1 s are linear functions of x defined in [1]. 
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Proof . By a Taylor expansion 


€ log (1 + es£ o (s)) = J € o O o s| o (s)]j , (69) 

j=l 

for |e s^ o (s)| < 1. Now, since ^ Q (s) is a polynomial in s, (40a), [l, (119b)], 
the right side of (69) is an infinite series in s and so 

CO 

€ log [1 + €S£ o (s)] = ^ , (70) 

j=l 

where the coefficients go., (j = 1, Z, • • • ), are to be determined. To 
accomplish this end, differentiate (70) with respect to s, obtaining 

Z 00 

€ d|>£ (s)]/ds ^ 

= X j w i sJ • ( 7l > 

i + ^e o (s) j=1 

However, from [l, ( 1 Z 3) ] 


and so (71) becomes 


n 


2' isi 'S= 


i= 1 


n 

= Z sl “X 

* 

(72) 

i= 1 

n 

CO 


i+e 2 s S 

2 V 1 = 

j=i 

(73a) 

i= 1 J 


CO 

n co 


I.jy 1 + 

e 2 2 j *°j*i sl+J-1 • 

(73b) 

j=i 

i=l j=l 
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Let k = i-fj in the second sum on the right-hand side of (7 3b) and 
replace the index j by k-i to obtain 


n 



i=l 


CO 



j=l 


n oo 


2 2 (k - i) ^“k-i sk ' 1 • 

i= 1 k=i + 1 


Then, interchanging the order of summation for the terms in 





i= 1 


CO 



J- 


1 


min 

oo (k- 1 , n) 

2 < k - i >* i “ k -i sk ' 1 

k =2 i=l 


Now, equating like coefficients of s in (7 5), 


"1 = b 


Cl - <p 


min 
(v-l, n) 

77 ) (v-i) 0 .co 

v ,r i v-i 

i= 1 


(v = 1 , 2 , * * • ) 


For v = 2, 3, • • • , n, let m = v-i and replace i in (76b). Then 


v=l 

to = 0 ., - 77 / moo 0 , ( v = 2 , • * • , n) . 

v rv v m y v -m v 

m=l 


For v= n+1, • • • , replace v in (7 6 b) by v+n and obtain 


n 


CO 


v-bn 


= " 77n 2 * l ' +n ' i ^i'"v+n-i ’ < w = 1 ' Z ' ' ' ' > 


i=l 


(74) 
que stion 

(75) 

(76a) 

(76b) 

(77a) 

(77b) 
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Thus the to 1 s can be generated recursively as functions of the 0's as 
claimed. 

Note that, using (70), (40b) can be expressed now by 


1 2»^i Jl a(s) 8 A j 


ds 


( 78 ) 


M=p j=i 


As shown in [1, (29)] , 


A(s) 


= 2 


P <S - (n+i) ; 


( |s| > p) 


(79) 


i =0 


where the (3's obey (67a, b, c). Then (78) becomes 


°-i = — <f Y y (3 iW .s- n - i+ J +1 - 2 ds, (i = l,2,-*-,n) .(80a) 

2 it n£-1 J ~ J 


, i i=0j=l 
s=p J 


By residues, this becomes [-n-i+j+i-1 = 0 when j = i+n+l-i] 


"i = 2 p . 


i W i+n+l-i 


• , (i = 1, 2, • • • , n) , 


(80b) 


i= 0 


the desired result. 

Corollary 8. 1 . The nth order scalar differential equation 


d n e 


dt 


n 


= eW = e 


(81) 
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has for a complete system of integrals and an isochrone the 
multinomials 


O' . 

1 


c r. 
1 




( 82 ) 


defined recursively by 


cr 

n 


= 9 


[n-l] 

1 


(83a) 


0" . 
1 


= e 


[i-ii 

i 


n-i 


n- i + 1 


m=l 


mcr 


n-mf 


fi [i+m- 1] 

r i 


(i = 1, 2, • • • , n- 1) (83b) 


Proof. Since the characteristic equation for (81) is A(s) = s n , 
a = a_ = . . . = a _ = 0. Then from (67a, b) it is clear that 6 „ = 0 , 

(i = 1, 2, • • • ), and so (66) becomes cr. = Also, by [1, (65)] 

0. = 0 n ^ = 0 f n “^, (i = 1, 2, • • • , n). Thus (68a) yields (83a) and (68b) 
yields (83b), directly. 

The integrals of 0 ^ = € and 0 ^ = € given in [3] can be gener- 
ated systematically by use of (83). 
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CLOSED-FORM EXPRESSIONS FOR COEFFICIENTS 
OF POWER SERIES EXPANSION OF <r 

Theorem 9. The functions o\ defined in (40) may be expressed as 


j = (A ‘ ) j “ 1 b-x - \ e (x-Q.x) + • • • , (j = 1 , 2, • • • , n ) 


(84a) 


where (see [i] ) 


Qj = (P“V 


0 o 
0 0 
0 0 

• • 

1 

*1 <*2 


0 

1 


1 p 


P „-3 P „-2 

K-Z K., K 


D 


-1 


(84b) 




D = (Sjb, S 2 b, 


. S n b), S 


n 

. = 2 «• 
1 J 


J " 1 


(84c) 


D = (a, Aa, 


, A n_1 a), D*b = e n . 


(84d) 


Qj +1 = A Qj , (j = 1, 2, • • • , n-1) 


(84e) 


Proof . It is well known that for k. t . 

i s i 


< 1, 


rr log (1 + € Mi> = e2 h- + 


(85) 
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For simplicity, assume (temporarily) that the are distinct. Then 
(45) becomes 


n (xA 1 


n (xA 1 


v ni . i £ v : x y + ••• 

j “ 2 j A'(\.) h 2 . 2 -/ A'(\.) i^i 

i=l 1 i=l 


( 86 ) 


By [1, (98)] and [ 1, (49a) ] 


E t\ J " 1 

V ' v * / 


(J - 

J 




i= 1 


(87) 


Now since P . - v *x, 
s i 


n ( x .) j_1 


y yy x * . y 

Z A'(\) ■ Z 


n (\) 3 


i= 1 


i= 1 


A'(\) 


" v (v ) ‘ X = X-Q.X 


( 88 ) 


where 


n ixn J 


„ A V 1 i, v 

Q j = 2, ^Txl v (v 1 

i= 1 


(89) 


Since v 1 is an eigenvector of A [l, (122a)], 


n (XJ j+1 


A! °j = 2 tw ,vl)(vl) ” = Q j+i 


. (j= 1. * ’ * . n- 1). 


i= 1 


(90) 
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'However, by [l, (105), (22a)] 




( 91 ) 


Define the matrix E by 


n 


^2 

i=l 


h. 


1 / V 

z (z ) 


(92) 


where the .z 1 are the columns of Z # Then by [l, (75)], the (v , p)— 
element of E is 


n 


v „ p 
e *Ee r 


= i 

i= 1 


4 ( V '" 1 


(93) 


In Appendix 3, it is shown that 


V r> [I 

e *Ee r 


l 


A'^) 


= P 


v+p-n 


(v, p = 1, • * • , n) , (94) 


when the (3* s are defined as in (67a, b, c). Thus the theorem is proved 
for simple matrices A. 

However, since (40) is analytic in a neighborhood of x= 0, there 
exist vectors f 1 = i 1 (A, a) and matrices R., (A, a) such that 

c r. = l € (x*R.x) + • # , (j = 1, 2, • * • , n) , (95) 

j ^ J 
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for all A. Furthermore, f l (A, a) and IF (A, a) are rational functions 
of the elements of (A, a). But the expressions in (84) are well-defined 
rational functions of (A, a) whether or not A is simple, and it has just 
been proved that 

i j = (aV" 1 b , R = (A'V " 1 (j = 1, * * * , n) , (96) 

whenever A is simple. Hence by the continuity argument used after 
(65), the relationships (96) must remain valid for all matrices A, simple 
or not. This concludes the? proof. 

Note: The Jacobian matrix for the transformation defined in (40) is, by 

(84a), L = [b, A*b, (aY’ 1 ^. From [l, (16)] det L = det D 

and L is non- singular if the system (32) is controllable. Thus 
the au (i = 1 , 2, • • • , n) defined by (40) are indeed functionally 
independent at x= 0. 

CONCLUSIONS 

The functions c r. (x, e ) may be mechanized to any desired degree 
of accuracy by means of (45), or (66)- (67), or (84). This facilitates the 
synthesis of optimal feedback control systems as indicated in the discus- 
sion following Theorem 5. 
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APPENDIX 1 


IMPLICIT FUNCTION THEOREM 

Consider the m- valued vector function f(x, y) where 

* , x ) ' p and y = (y , y ? , ••• , y ) Suppose that 
it x. l, m 

f(x, y) has continuous first partial derivatives with respect to the 
components of y in a neighborhood of a point (x, y). If 


x = ( x i* X 2’ 


(i) 

(ii) 


f(x, 9) = 0 


(1. 1) 


det 


9f l 

9f 2 


9f 

m 

971 

9y l 


9y l 

9f l 

9f 2 


9f 

m 

9y 2 

9y 2 

• 

9y 2 

9f l 

9f 2 

• 

9f 

m 

9y m 

9y m 


3y 
7 m 


( 1 . 2 ) 


/ 0 , 


J (x,y) 

then there exists in a neighborhood of (x, y) a unique set of functions 
g i = g i( x ) ’ ( i = 1» *•* » nr), such that 

Y ! = 

y 2 = § 2 (x) (1. 3) 

y m _ ^m^ X ^ 


represents the solution of f(x, y) = 0 near (x, y) in the sense that 

f(x, g(x)) = 0 (1. 4) 


is valid in this neighborhood. 
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APPENDIX 2 


Theorem . If the roots X of A(s) = 0 are distinct, then 


n i_ 1 

(M J 


2 

i = 1 


A' (\.) = 6 jn 


(j = 1, 2, • • • , n) 


(2. 1) 


Proof. (D. C. Lewis). By the theory of residues, 


r J-i v- 

J> = (j = 1.2. 3...) , (2.2) 


" WJ - 1 


» = P 


i=n 


A'(X.) * 


where p > max | | , (i = 1, 2, - # , n). Now evaluating the above 

integral directly as p becomes arbitrarily large yields 


>2tt 


j-1 


j A(s) 

|s| = P 


ds - 


lim 

P— CO 


Ztt \T-I dy 


n 


(2. 3) 


^ P (m "^ exp [(m-j) /UTy] 


0 m=0 


where s = p exp ( \l - 1 y ). For j = 1, Z, * * , n - 1 , then, 


§ A(s) ds " 0 ’ ^ 

|s| = P 
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and for j = n 


f 

l s l= p 





Thus from (2. 2) and (2. 5) the theorem is proven. 


(2. 5) 
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APPENDIX 3 


Theorem. If the roots of A(s) = 0 are distinct, then 


2 



A' (\) 



(j = 1, 2, 3, • • • ). 


(3. 1) 


Proof, from (79) 


* 1 00 


(3.2) 


| s|= p 


|s|= P v-0 


By the theory of residues [ -n-v+j = 0 when v - j-n] 


f 5T7) ds = *V 

w= p 


Combining this with(2.2) gives the desired result immediately. 
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Abstract 

For n& order constant plants, it is known 
(Letov, 1960) how to pick n desired closed-loop 
poles guaranteeing optimality relative to quadratic 
integral criteria. Also it is known (Bass, 1961) 
how to synthesize closed-loop poles arbitrarily by 
state -variable feedback, provided Kalman's criter- 
ion of controllability is satisfied. In this work these 
principles are combined into a unified design pro- 
cedure incorporating the algorithm of Leverrier 
(1840). If only m < n outputs can be measured, an 
ideal system can be synthesized “asymptotically" 
by a feedback filter which processes the outputs, 
provided Kalman's criterion of observability is 
satisfied. If the filter is physically realizable by 
a passive network, the absolute smallest number of 
new poles which must be introduced for mere sta- 
bility is in general [(n/m)-l]. But the only general 
designs of the filter are those of Kalman (1961) and 
Luenberger ( 19 64) which introduce, respectively, 
n and n - m new. poles . Here a closed -form compu- 
ter oriented general synthesis algorithm is 
presented which designs the filter to have only 
about [(n/m) - 1)] poles. 

Introduction: Matrix Transfer Functions 

and the Resolvent; Lever rier 1 s Algorithm 

Consider the open-loop system (uncontrolled 
system or plant) which evolves in time according 
to the differential equation 

x = Ax , x(0 ) = x°. (1) 

Let s be a complex variable, and let £ denote the 
Laplace transform operator; write x(s) for £x(t). 
Applying £ to (1), obtain sx(s) - x° = Ax(s), or 
x(s) = (si - A)'^x°. By Cramer's rule, the resol - 
vent matrix (sI-A)* 1 is such that each of its ele- 
ments is a ratio of polynomials in s (transfer 
function ), and is defined whenever s is not a root 
of A(s) = 0, where 

n 

A(s) = det (si - A) = X ajs 1 , (a =1) (2) 

i= 0 n 


Now it is well known [4] that the resolvent [open- 
loop transfer matrix] is 


n i-1 

(sI-A)'^ r(s)/A(s) = Z|^|s.. 


( 6 ) 


The theoretical definitions (2), (5) are useless for 
large n since they involve n! multiplications. Alter- 
natively, a recursive algorithm for computing 

a o’ a l* * * * * a n -l anC * ^1’ ^2’ * * * 9 ^ n -l * n a ^ out 
multiplications can be derived from Newton's iden- 
tities between the a j and the elementary symmetric 
functions of the roots [open-loop poles or plant 
poles] of (2); this is [6, 7] Leverrier 's Algorithm 
(1840), sometimes called by other names W since 
it has been independently rediscovered or improved 
by Horst (1935), Souriau (1948), Frame (1949), and 
Faddeev and Sominskii (1949). The algorithm is, 
for (j = 1, 2,*.-, n), 


a 

n 


* i. 



(7a) 


“n-j= -(l/j)tr(AS n _. +1 ), S n ..= % ..I + AS n . j+1 . 

(7b) 

As an automatic self -check on round-off error, 
note that (in theory) S Q = 0. The first mention of 
(7) in control literature appears to be that of Zadeh 
and Desoer [5] in 1963, although one of the present 
authors has used (7) in actual control design since 
1960 [1,2]. 


Relation between Open -loop Poles an d 
Closed -loop Poles 

Suppose that the rate of change of the state vec- 
tor is modified by a forcing function 4 Q a, where the 
scalar function 4 Q = 4 Q (x) * s tlie feedback control 
law and the constant vector a = (a.) is the actuator 
vector. Thus .... 1 

x - Ax + a^ . (8) 


For linear control 

= g * x = g* x . 


(9) 


is the open-loop c haracteristic polynomial . Now 
clearly the general solution of (1) is 

x(t) = exp (At)x°, exp (At) = X~ l { (sI-A)" 1 } , (3) 

where each element of the state -transition matrix 
exp (At) is the inverse Laplace transform of the 
corresponding element of the resolvent. A more 
explicit form of the resolvent can be defined ( ^ ) in 
terms of the matrix polynomial [numerator transfer 
matrix] 

r<s) g f^S (4) 

i=l 1 

where the matrices S. are defined for i = 0, 1,2,*--, n 
by n 1 

S. ^ ^ A J-i , < S n =I) - (5) 

j=i 


where matrix transposition is denoted by an aster- 
isk (*). (Vectors are columns unless otherwise 
specified. ) Thus (8)-(9) becomes the closed-loop 
system 


x = (A + ag*)x = Ax 

(10) 

n 

A(s) = det(sI-A) = y a. s' 

(ID 

i= 0 1 


defines the closed-loop characteristic polynomial . 
Since computer algorithms for finding the roots 
{given theaq), or conversely, for synthesizing the 
o>i (given the roots), are standard, the specifica- 
tion of the system poles and of A will be treated 
as equivalent propositions. Although there are 
various ways of choosing a desirable A, it will be 
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assumed for the present that this choice isjiot an 
issue. Of course, it is required that exp (At) decay 
to zero as t increases; hence the system_poles must 
have negative real parts. Accordingly, A must be 
a Hurwitz polynomial . Here the relationship be- 
tween A and A is analyzed assuming only that the 
gain vector g is known. 

By means of the numerator transfer matrix 
r(s) it will be shown that [1,2] 

A(s) = A(s) - g. r(s)a, (12a) 

or, equivalently 

a. = a. - g * S. . a , (i = 0, 1, ■ ■ n-1) . (12b) 

i i 6 l+l 

The proof of (12) rests on the determinantal identity 

det(I+cd*) = 1 + d*c . (13) 

To establish (1^) ; that (because a determinant 

is an alternating multilinear function of its column 
vectors) det (1+ cd*) = det (el + dje, * • *, e n + d n c) = 
det (e*,***, e n )+'d 1 det (c, e^ , . • . , e n ) + • ■ • + d n det (el, 
e^, . • . , c ) = 1 + djci +•♦• +d n c n = 1 + d • c. Now (12a) 
follows trivially from (6) and (13) since A(s) = 
det (sI-A-ag*) = det (sI-A)det (I - [r(s)/ A(s)]ag*) = 
A(s){ 1 - [ 1/A(s)] g . r(s)a} = A(s) - g*r(s) a. (Note 
that (12) is the basic lemma in Kalman's 1964 
paper [3], where (13) is referred to as a "well- 
known matrix identity"; recently Kalman has 
acknowledged [l], [2] as his source. See Appendix. ) 

Controllability and Synthesis of Arbitrarily 
Specified Closed-loop Poles by 
State -variable Feedback 

The system (8) is controllable in the sense of 
Kalman [ 1 1] when 

detD 4 0, D = (a, Aa, A 2 a, ••• , A n l a) . (14) 

Accordingly, the system of linear algebraic 
equations 

(A M a)-b = 6. , (i= 1, 2, — ,n), (15a) 

where 6i n is the Kronecker delta, or, equivalently 
D*b = e n , (b= (D-l)*e n ), (15b) 

has a unique solution b ^ 0 if and only if the system 
is controllable. (e n is the ntt column of the identity 
matrix. ) The vector b is important because the 
system (8) is precisely equivalent [ 1 0] to the scalar 
ntb order system 

A(d/dt)Gj = i|j (16) 

under the explicit, reciprocal transformations 

0j = b-x, x = {r(d/dt)ej}a. (17) 

One may compute b from (15a) by Gaussian elimina- 
tion [7], which in general requires only (l/n)£h of 
the arithmetic labor of computing D~l. Furthermore, 
once b is known, D" 1 is known explicitly, for in[l0] 
the present authors have established the useful 
matrix identities [det D s 1/det L] 

D' X = (a,Aa,... 1 A n ' 1 a)' 1 = (S*b, S*b,.-. , S*b)*, (18a) 

l c. n 

L' 1 ^ (b,A*b,.» > (A' 1 ‘) n ‘ 1 bf 1 = (S 1 a,S 2 a,...,S n a)*. (18b) 

The linear relations (12) may be collected into 
the vector equation n 

(S l a ’ S 2 a '"-, S n a)Vg = <“i_l *“i-l )e1 ' (19) 


Now from (18b) and the Fredholm Alternative [ 1 5] 
for singular equations, the following result [l],[2] 
may be concluded. The system (8 ) - (9 > may be 
synthesized with arbitrarily specified closed-loop 
poles if and only if U is controllable , in which case 
the gain vector g is, explicitly , 

g = - E <“i-i * < 2 °> 

i= 1 

The execution of (20) on a digital computer, via 
Leverrier's algorithm for finding the from A, 
takes but a few seconds. As a self-check, the 
authors' program also computes A = A + ag* and 
then reapplies Leverrier's algorithm to verify that 
the synthesized A agrees with the specified A. 

Observability and Practical Asymptotic 
Heal xz.<a.i.ujii ui xaeai oysiem by 
Liowest-order Feedback Filter 

The utility of the gain vector g computed by 

(20) might be doubted, in that for large n not all 
state -variables x^ may be measured by convenient 
instrumentation. Typically, the only available 
system output is a set of m independent, known 
linear combinations of the x^, say 

y. = h. 1 * x, (i = 1,* • • ,m; 1 < m< n) . (21a) 

Thus the output -vector y is defined by 

y = H*x, H = (h*,---, h m ) , (21b) 

where the known nXm matrix H has rank m<n. 

The system is no longer defined by (8) -(9), but by 

(21) together with 

x = Ax + ai|i Q , “ ^(y) I (22) 

where \\i Q at time t is no longer a function of the 
instantaneous state x(t), but rather a "functional" 
(operator) on y which depends not only on y(t), but 
also on its past history { y( T) | 0 < T < t}. 

The most precise approach to filter design is 
based upon Kalman’s generalization [ 1 8] of the 
Weiner -Kolmogorov theory of optimal extraction of 
signals from noise. It can be proved [19],[20] that 
when the choice of the ideal system £ = Ax is opti- 
mized according to a quadratic performance crite- 
rion, the problem of optimal choice of 4* 0 in ( 2 1 )-(22) 
can be split into two separate problems. The first 
deals with optimal choice of g, and the second deals 
with real-time minimal -variance unbiased estimates 
x of x. If y = H*x + w where w is a Gaussian 
white noise process of a priori known spectral 
power density, then ijj = g • x. It can be proved 
{unify [12], [18] as in [l9]-[20]; then specialize to 
the autonomous case as in [3]; finally, convert to 
scalar form, as in ( 1 6), by transformations analo - 
gous to (17)} that the optimal control law can be 
synthesized by feeding back the observed outputs 
y- through a suitable passive linear filter as in 
Figure 1. (The Pl (s) are physically realizable trans- 
fer functions having the same poles but different 
zeros. ) However, such a filter requires n poles 
for an nth order system. Unfortunately, for large 
n this approach, although precise, is impractical 
in many applications. 

Abandoning the attempt to estimate 4« 0 opti- 
mally, a somewhat more economical realization 
theory may be developed [16] wherein the number 
of filter poles is equal to n-m. In this theory, 


C-2 


(28b) 



LINES INDICATE SCALARS) 


Figure 1. Closed loop system. 


the ideal closed -loop system (including filter) may 
be specified arbitrarily. 

For both theories [18] and [ 1 6], an essential 
hypothesis is that of plant observability , defined as 

rank[H,A*H, (A*) 2 H, ... , {A*) n_1 H] = n (23) 

The present theory, however, is based on ideal - 
system observability 

rankt H,(A*)H,(A*) 2 H, ... , (A*) n ~*H] = n (24) 

and is essentially different from the others. [Note 
that either (23) or (24) may hold while the other 
fails. ] It will be shown that if m > 2, (24) yields 

[ (n/m) - l] < n - v < n -m (25) 

where n-v is the number of filter poles required. 
Often, n-v can be arranged to equal or approxi- 
mate the lower bound in (25). 


Refer to the configuration of Figure 1. In 
terms of Laplace transforms it is clear that 

4j q (s) = 2 . p^(s )y^(s). Call the common poles of 
the p^(s) the open-loop filter poles , and let them 
be the roots of a polynomial ^(s) = IF^y^s^. 
Similarly, let the zeros of p^.(s) be the roots of 
A (i) (s) - *>0 V j - (i= L 2 >-">m). Then Pi (s) = 

A(i)(s)/A n v (s), and in the time -domain the com- 
plete system is given by (8), (21b), and 
m 

A n-v (d/dt) ‘ t o = Z 1 A (i) (d/dt)y i' < 26 > 

Applying the transformation (17), the system 
reduces to the scalar form 


A(d/dt)G 1 = i|j , (27a) 

m n 

A n-v (d/dt) ^o = .2 A (i)( d /dt)E( hi * S.a)ep" lJ . (27b) 

where 0^ = d*8./dt*. From (27) it can be seen 
that 1 1 

A Znv (didt)Q l = 0, (28a) 


m n 



where ^2n-v^ s ^ *- s a polynomial of degree 2n-v 
whose roots are the actual overall system poles . 

Let the open-loop filter poles (A n _ v ) as well 
as the ideal system poles (A) be specified arbitrar- 
ily. Then the only unknowns in (28) are the poly- 
nomials A(j\, (i = l,2,***,m), whose determination 
completes the design of the feedback filter. For 
physical realizability of the filter alone, 0 < v. < 
n-v, (i = 1, 2, • • m) must be satisfied. 

As part of the closed-loop system, the filter 
will be said to realize the ideal system if 

A 2n-v (s> = A(s)A n-v (s) ' (29) 

where A n _ v is a Hurwitz polynomial whose roots 
will be called the closed-loop filter poles. The 
realization will be called asympto tic if the open- 
loop and closed-loop filter poles tend to coincide 
when the real parts of either set are moved uni- 
formly toward negative infinity. 

Assume the validity of (24) and seek an asym- 
totic realization in which £ and A n _ v are specified 
arbitrarily, and the coefficients y^j of the A(j) are 
determined as linear combinationsof the (arbitrary) 
coefficients y^ of A n _ v . The relation between Yij 
and the y. will at first be inferred from a heuristic 
argument; then it will be shown that a filter designed 
by this method 'is indeed asymptotic. 

Referring to (27b), attempt to choose the A... 
so that 

m 

A n (d/dt)(g -x) = ]] Aj.^d/dtMh^x) . (30) 

i= 1 ; 

This could be true identically if x = x(t) solved 
x = Ax exactly; but note the transient introduced by 
the filter. Proceeding, however, on this "asym- 
totic" assumption, d*x/dP = (A) x x, holds, with x° 
arbitrary, and (30) reduces to 
m 

A n . v (A*)g= I> (i) <AV (31) 

Define r = (v q , Y^-" . Y„. v )* . Q - (g. A*g, ■ • • , (A*) n " V g), 

and, noting the corresponding dimensions, define 
matrices and vectors, for (i = 1, *•• , m), by 

K. = <hUV.»..(XW). [nx(v.+ D] ; 

d 1 = [lX(v. + 1)] ; 

K = (K r ■,K m ), and d = [ (d 1 )*, • • (d m )*] * 

Then the condition (31) can be expressed as Kd = Qr. 

The smallest n-v must satisfy n-v = maxlv, v }. 

I m 

On the other hand, for K to be an nXn matrix, the 
dimensions v^ must satisfy n = (v^+l)+ (v^+l)* + 

(v m +l) or v i + v 2 + ‘" + v m = n " m - F rom this (25) 
follows immediately. If vj = v^ = ••• = v m , then 
v. = [(n/m) - l] = n-v . Note that the columns of K can 
be arranged at will if the elements of d are adjusted 
accordingly. In particular, generate a new matrix 
K as follows. 
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(a) Start with the columns h 1 , h 2 , ••• , h m . 

(b) Adjoin to this the columns (A )h , (A )h ,*•*, 
(A*)hm one by one, checking that each new column 
is linearly independent of the previous ones. (Use 
the Gram-Schmidt orthogonalization procedure. ) 

(c) If any of the new columns is found to be 
dependent, omit it from the matrix and go on to the 
next. 

(d) Continue adjoining columns until n linearly 
independent ones have been found. 

(e) After (A*)h m has been tested, continue with 

(AVh 1 , , (A*) 2 ^, (A* ) 3 h 1 , - . <ATh m , - , 

(A* ) n 'l h l,-,(A*) n ' 1 h m . 

(f) If a column (A*)V has been skipped 
because of linear dependence., all rnlnmnc 0 f the 

form (A*) 4 ^ where i > i can be skipped, immedi- 
ately, since they also must be dependent on the 
previous columns. 

When observability applies in the form (24), 
there must be n linearly independent columns in the 
matrix K generated as described above. If d is 
the correspondingly ordered vector of n unknowns, 
the system Kd = Qr can be solved for the elements 
of d, which (after appropriate re -ordering) define 
the numerator polynomials A,^t of the desired feed- 
back filter. 


Previously, it was required that the filter in 
question obey (29). This can be verified by an 
algebraic manipulation which is both tedious and 
rather subtle. Indeed, it can be shown that A n _ v 
and A n _ v are related by the equation 




i-1 


n-v m 

k=i 


• A k_i a) 


(32) 


for (i = 1, 2, , n-v ), where now one defines = 0 

for k>vj. From the form of (32) the asymptotic 
equivalence between A n _ v and A n _ v follows 
readily. 


Optimal Choice of Closed-loop Poles 

Up to this point it has been shown that, given a 
desired A(s), a unique gain vector g can be found 
(20) so that the ideal system 

x = Ax = (A + ag^Jx = Ax + ai^, 4J Q =g' x » x(0) = x° 

(33) 

is synthesized by 4*o " 8 ’ x ‘ When only an output 
y^H^x is observed, can asymptotically syn- 
thesized as 4i -'f(y) by means of the feedback filter 
(26). ° 

For large n, however, the available arbitrari- 
ness in specification of A(s) constitutes an "embar- 
rassment of riches. 11 To remedy this, the question 
of choosing a control law that will optimize some 
performance criterion will be considered. For 
present purposes define this criterion as 


$ 



x * Cx + 


+ 0 2 >dt, 


c=c*20 , 


(34) 


and call the control ^ "optimal" if it minimizes (34). 

The choice of an appropriate matrixCis impor- 
tant. It must be done in the context of a specific 
problem. For example, in aerospace vehicle 


stabilization it may be required to maintain certain 
quantities Iq 1 - x| , (i = 1 , 2, ■ , m), such as "struc- 
tural load", "pitch error", etc. , below stated 
bounds while minimizing the maxjmum QXZX future . 
time of some critical quantity Iq** 1 • x | , such as 
"lateral drift. " The important minimax control 
problem may be solved to a first approximation 
[exact solution requires nonlinear feedback] by noting 

that, in the integral (q m • x(t)/K D ) 2 dt, the total 

contribution of times at which |q m *x(t)| > holds is 
"penalized" disproportionately in comparison to that 
of times at which [ q 1 * 1 • x(t) | < k q holds . Hence it 
would be desirable to find a performance criterion 
which minimizes the above integral while at the 

same time maintaining jf (q L *x) dt, (i=l,2, •••, 

m-1) and f + \b 2 dt within required bounds. All this 
^0 ° 

can be accomplished by defining 


A l 1 * m. m.* /oc\ 

C S ^q (q ) + ••• + K rh q (q ] (35> 

in (34). If m > n, and the q 1 are linearly independent, 
C is positive definite. The theoretical development 
of this case is more straightforward than that for 
which m < n and C is only guaranteed non-negative 
definite. 


Another approach to choosing C can be found 
in the "implicit model reference" method mentioned 
by Soviet authors such as Aizerman. Basically, it 
is desired to force 9} = b • x to behave in the mean 
like solutions of A^(d/dt)6 1 = 0 where Afi(s) is a 
Hurwitz polynomial of degree < n. Using (17) it 
is clear that Aft(d/dt)6 1 = [Aft(A*)b] * x whence the 
matrix C to be used in (34) is 

C - qq* , q^A ft (A*)b. (36) 


The first general results on the solution of the 
problem described in (33)-(34) are due to Bellman, 
Glicksberg and Gross in 1954 (cf. [9] ). After slight 
modification of their derivation, it can be shown that 
their work gives, for C > 0 

= a • p , (37) 

where the "co -state" vector p satisfies the two- 
po int Lagrangian bo undary- value problem defined by 
( 1 ) and 

p+ (A* -CAC _1 )p - C(AC ^A* + aa*)p = 0, x<+») = 0 • 

(38) 

However, the numerical methods they suggest for 
solving (38) apply only for fixed x° and do not yield 
(37) in the feedback form ^ Q (x) needed for synthesis. 

In 1960, Letov [21] implicitly assumed con- 
trollability via the use of Lur'e coordinates [ 10] and 
improved (37) by showing that under slight restric- 
tions there exists a constant matrix B such that 

p = -Bx, (39) 

whence the optimal control law determined by (34) 
is linear: 

+ Q = g-X. g--Ba. (40) 

Letov applied the classical Euler-Lagrange neces- 
sary conditions to (33) — (34). and expressed the 
result in Hamiltonian form [readily seen equivalent 
to (38)] 
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H 




(41) 


After defining A2 n ( s ) - det(sl2 n - H) and showing 
that A 2 n (s) is a polynomial in even powers of s 
only, he concluded that if the roots of this polyno- 
mial are distinct and non-imaginar y, the n Hurwitz 
roots are the optimal poles of (33)-{34). Hence 


A 2n (s) = (-l) n A(-s)A(s). 


An explicit expression for A 2 n (s) can be 
obtained in the following way: 


Define 



(sI-A T^aa* 
I 


(42) 


(43) 


where det K = 1, and argue that 

A 2n = det[(sl 2n - H)K]- 

= det (sI-A)det[(sI + A*) - C(sl-A)~*aa*] = 

= A(s)det(sI + A*)det[I-(sI + A*r 1 C(sI-A)- 1 aa*] = 

= (-I) n A(s)A(-s)det [l-{r*(-s)/A(-s)}C{r(s)/A(s)} aa* 

Application of (13) then immediately yields the de- 
sired result 

A 2n (s)= (-l) n [A(s)A(-s) + a-r*(-s)Cr(s)a]. (44) 

The results (39), (40), and (42), (44) actually 
apply when the roots of A2n(s) are non-distinct and 
when C is only non -negative definite, provided that 
x • Cx is the square of an "observable" quantity. 

This can be deduced from Kalman’s nearly definitive 
studies [12], [3], which combine Pontriagin's neces- 
sary Maximum Principle [17] with the sufficient 
Hamilton -Jacobi partial differential equation [9]. 
Kalman shows that the optimal control law for 
x = Ax + a(g*x) defined by the criterion (34) is given 
by g = - Ba, and is stable if there exists a symmetric 
B > 0 satisfying 

BA + A*B - B aa* B = - C . (45) 

Under these conditions, the function x • Bx is a 
Liapunov function for the closed-loop system 
x = Ax; and B must be given [9] by 

B = /exp(A*t)[C + gg*] exp (At) dt . (46) 

J 0 

Furthermore, $ = $(x°) = |x°- Bx° and p = -grad $ = 

- Bx satisfies the necessary condition 
max p, ijj ) = 0 where 

* 

i¥= p * (Ax + a^) - (j)(x • Cx+ ^ Q 2 ) . (47) 

Although Kalman suggests a method for finding 
g explicitly (integration of a matrix -type Riccati 
differential equation), a more efficient approach, 
for (33), can be obtained by combining his work 
with that of Letov and (20) above. 

The results (45)-(46) are equivalent to (41), (44) 
as can be shown by the following argument. Rewrite 
(45) as B ( s I - A ) - (sl + A*)B = C - Baa*B. Premulti- 
plication by-a*r*(-s )/A(-s) and postmultiplication 
by (r(s)/A(s))a yields (after multiplication by 
-A(-s)A(s) and substitution on the left of g = - Ba) 
the result -a*T*(-s)gA(s) - g*r(s)aA(-s) = 

(-s)(C - Baa*B)r(s)a. Now adding A(s)A(-s) 


to both sides and rearranging gives, after use 
of (12), 

A(s)A(-s) = A(-s)A(s) + a • T* (-s)Cr(s)a (48) 
which is exactly equivalent to (42), (44). 

Note that since the A(s) determined from (48) 
by construction must be Hurwitz, (46) must yield 
aB>0ifC>0 and so (48) is totally consistent with 
(41). For a semi -definite C, additional conditions 
must be satisfied to ensure that B > 0. Consider 
the polynomial a * F *(-s)CF(s)a. Then for C > 0, 
a * r*(-s)Cr(s)a = Aa(-s)A^(s) where Ag(s) is a 
polynomial of degree n < n-1 (<n) whose coefficients 
are readily computable. Now define a vector q 

by the relation A^(s ) = = q* F(s)a. Then 

p. = q • S.a, (i = 1, 2,***, n), or (S^, — , S 2 a)*q = q 

where q denotes the vector of coefficients of A~(s). 
Applying (18b), it is clear that q = A$(A* )b. Thus 

a * r*(-s)Cr(s)a s [q- r(-s)a][q • T(s)a] . (49) 

This important result shows that, by (48), the matrix 
C can be replaced in $ by a new matrix defined as 
in (36) without affecting the determination of the 
optimal control law. In other words, minimizing 
the $ of (34) is exactly equivalent to minimizing the 
simpler performance criterion 

+ C0 

* ' =if[( q*x) 2 + (g-x) 2 ]dt. (50) 

0 

Then in (46), B > 0 unless for some x° ^ 0, 

(g * x ) — 0 and (q -jc) =0, 0 < t < +®. But in this 
case, x(t) = exp (At)x° = exp (At )^ whence the deri- 
vatives of q*x at t=0 become [(A*)* "*q]- x°, 

(i = l,-**,n). Now assume that q*x is observable ; 
that is 

det[q,A*q, •••,(A*) n ' 1 q] 0. (51) 

Then q • x = 0 implies the contradiction that x° = 0, 
i. e. , q * x = 0 is impossible and B > 0. 

As an alternative to (51) in checking that q-x£ 0 
when g- x = 0, consider the following argument. 

By (12a) and (17), if A(d/dt)8j = 0, then 

g*x - 0=> [g.r(d/dt)a]0 1 => A(d/dt)0j = 0. (52a) 

Similarly, from (36) and (52a), when g • x = 0 
is satisfied, 

q * x = 0 => A^(A*)b -x = A^(d/dt)6 1 = 0. (52b) 

Now, if A^(s) is a factor of A(s), A fi (d/dt)0, = 0 
implies that A(d/dt)6 L = 0, in which case (52b) holds. 
Conversely, if the conditions of (52) are both satis- 
fied, A£(s) must be a factor of A(s). This can be 
shown directly if the eigenvalues {^} of Aft(s) and 
those of A(s) are distinct. Making this assump- 

tion, and recalling that A^(s) = II [ s -'X.J, the gen- 
eral solution of Aft(d/dt)0j = 0 is a linear combination 
of the solutions of [(d/dt) -^]0i = 0, while a similar 
conclusion holds regarding the solution of 
A(d/dt)0j = 0 and^those of [(d/dt) - \ J0 j = 0. This 
implies that the \j,(i = 1, 2,***,n) are included in the 
Xp i. e. , A^(s) must be a factor of A(s). 

In order to extend this result to the general 

case, define a = ( a , or. , -•*,« .)*. Then 

o 1 n-1 
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the companion matrix C of A or A is defined as 
usual by C = (e 2 , • * , e n , - a)* . Now it can be shown 
(cf. techniques of [ 1 0] ) that, referring to (18b), 

[q,A*q, -.(A*) 11 -^] = LftH (8*f ’ 1 S]. 

(det L = 1/detD ^ 0) , (53) 

where ^ is as defined after (48). By controllability 
and (18b), the observability condition (51) is equiva- 
lent to 

det * 0. (54) 

Thus (54) is now sufficient to show that A^(s) and 
A(s) have no common factors for distinct roots of 
these polynomials. However det [q,C*q, • • •, {C* ) n q] 
is a multinomial in ^ and a i only; thus it must be the 
"resultant" ( the general condition for two 
polynomials to have no common factors) and so (51) 
is acLtisfied if and only if ^(s) is not a factor of 
A(s). 

It remains only to develop criteria for A to be 
Hurwitz, which are based on lecture notes distributed 
by W.M. Wonham at Purdue University. [In these 
notes, Wonham overlooks the necessity of a test of 
observability of q * x. ] If the open-loop characteris- 
tic polynomial A(s) has no purely imaginary roots, 

(48) can be written as 

|£(ju)| 2 = | A(ju,)l 2 + | q • r (ju)a | 2 2 |A(j«)| 2 > 0, 

-QO<0)<+00, j = \CT. 

This guarantees that none of the roots of A 2 n (s) are 
imaginary; hence A(s) will be Hurwitz. Furthermore, 
if 

S^-CSja > 0 (55) 

is satisfied, an open-loop pole at w= 0 does not pre- 
vent A(s) from being Hurwitz since 

|S(0)| 2 > 0 + | q • r(0)a | 2 = (S^) • C(Sja) > 0 . (56) 

Thus if the open-loop system has no imaginary poles 
except possibly at s = 0, in which case (55) is 
assumed to be satisfied, A(s) must be Hurwitz. 


(f) Compute the polynomial A 2n (s) by the 
following explicit expansion of (44): 
n-l 

A (- s ) A ( s ) = a 2 + y S\s 2l +(-l) n a 2 s 2n , (57a) 

o i l n 


i-1 

«i = (-l)V 2 +2 2 (-lA*.a 2i _. . (i=l,-,n-l), 

Alx (" 2 2 ) 

(0,2i-n) 


(57b) 


a • r*(-s)Cr(s)a = (SjaJ-CfSja) + 


n-2 



+ (-l) n " 1 (a-Ca)s 2n ; 2 




€ . 
1 


= (-l) i (S. +1 a)-C(S. +1 a) + 

+ 2 l |(-l)j(S j+1 a)-C(S 2H+1 


max 

(0, 2i-n+l) 


a), 


(i=l. ,n-2), 

(n 2 3) «57d) 


(g) Alternatively, Leverrier's algorithm can be 
applied to the 2n X 2n matrix H of (41) to 
give A 2n (s) - 

(h) Find the roots of A 2n (s), and from the n 
roots that have negative real parts generate 
the unique polynomial A(s) such that 
A 2n (s) = <-l) n A(-s)S(s). 

(i) Insert the coefficients of A into (20) to find 
the desired optimal gain vector g. In 
practice it is useful to compute a one - 
parameter family of gain vectors, say 

g = g ( m- o ) , by replacing C with H 0 C, 

0 c jjl 0 < +co, and letting M- 0 vary over the 
positive real numbers. 


These concepts are now unified into an actual 
design procedure. 

(a) Choose an appropriate matrix C by the 
methods of (35) or (36) above. 

(b) Compute A(s) by Leverrier's algorithm (7). 

(c) Find the roots of A(s) = 0. If A(s) has 
purely imaginary roots (other than s = 0) 
modify A until it has none. If A(0) = 0, 
also check the condition 

<S ia )*C(S ia ) > 0; 

if it fails, modify C until it holds. 

(d) As explained above (49), compute the 
vector q = A^(A*)b such that 

a • r*(-s)Cr(s)a s [ q ■ T{-s)a][q • T(s)a] = 

= A^(-s)A ft (s) . 

(e) Find the roots of A^(s) = 0. If A^(s) is a 
factor of A(s), modify C until it is not. 


Intrinsic Adaptivity to Actuator Saturation 

In engineering practice, of course, actuators 
are linear only over a finite range and have limited 
amplitude. By renormalizing || a || if necessary, it 
can be assumed without loss of generality that, in (8), 



Hence it is of great interest to study the behavior of 


(8) under the control law 

- P 0 sa t [n o ( g -x)/p o ], (59) 

L<p <+co, 1 <|jl<+co, (60) 

2 r Q ' 2 O 

where satfej = 0 for 1 0 O I - 1 and sat[0 Q ] = sgn[e Q ] 

for |e I ^ l.° Note that if instead of (60) one requires 
1 o 1 

1 < p < + co l<M-<+co, (61) 

“ o O 

then there is a clear physical interpretation to (59) 
and (61); in fact, 

$ o = p Q (g- x), |g-x| S (p 0 /P 0 ), (62) 
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i. e. , the control law (59) is linear at least in the 
region 

lull S (p 0 /n 0 llg||), (63) 

while increasing > 1 is the same as increasing 
the control signal gain || g || , and increasing p > 1 
is the same as increasing the actuator amplitude 

II a II . 

Use of (59) permits what seems to be the first 
unified theory of linear, linear -saturating, and 
bang -bang control. Clearly the extremes are 

M- Q =l, P o = + c0 . (LINEAR CONTROL,^ =g-x) (64) 

p 0 = P Q =+» , (BANG-BANG CONTROL, 

= sgn[g *x] ) (65) 

There are two important performance criteria 
applicable to (8) and (59), namely 


+ C0 



and the largest number X > 0 such that for some 

y > 1, ° 

*o 

IU(t)|| < ||x°||v o exp(-X o t), (0<t<+co), (67) 

whenever 

II x ° II s (p 0 /v 0 llgll ) • (68) 

Referring to (45), and using x • Bx as a Liapunov 
function, it can be shown that if g = - Ba is computed 
as in the procedure above, the system (8), (59), (68) 
is asymptotically stable on (60); |j x °||<2 P 0 /(Y o ). 

Moreover, neither performance criterion ^ or 
is degraded by allowing p Q , to vary on ( 6 1) I 

This truly remarkable property of the gain 
vector g = g(a, A, C) obviously enhances the practical 
usefulness of the design procedures developed above. 

Conclusions 

A unified practical algorithm for the design of 
lowest-order [physically realizable] asymptotic 
realizations of ideal optimal control systems is 
obtained by combining the just-listed procedure 
(a)-(i) with the procedure (a) - (f) preceding (32). 

The authors have implemented this in a digital com- 
puter program. Inputs to the computer are plant 
matrix A; actuator vector a; sensor vectors hl,h 2 ---, 
h m ; performance vectors q 1 , q 2 , • • *, q m ; trade-off 
coefficients *2’*'*’*nv and filter poles A n _ v (s). 
Outputs are optimal filter zeros A,-\(s), (i=l,*--,m) 
for asymptotic realization of the system which (in 
the mean-square) minimizes the performance index 

Vq 1 -x) 2 + * 2 (q 2 • x > 2+ ••• + * a (q a -x) 2 . 

Appendix 

R. E. Kalman has stated that he learned (13) 
from [l] [Z] , but subsequently encountered instances 
of its use by Caratheodory without comment (cf. [22], 
p. 342). Kalman has kindly supplied the following 
proof, which is amusing, but technically less ele- 
mentary than that given here. Since there must 
exist (n-1) linearly independent vectors u* orthogonal 
to d, (I + cd*) ui = u* + (d • u^)c = u*; hence 1+ cd* has 
n-1 eigenvalues X^l, (i = 1, 2, • • •, n-1). Now 


S + *’* + \ 1 + * ~ (n - 1) + X = tr (1+ cd*) = n + d • c, 

x n -i n n ’ 

whence det (I + cd* ) = X X ■ • * X X = \ = 1 + d ■ r 

1 2 n-1 n n 

Notational Conventions 

a. Matrices are upper case letters. 

b. Vectors are lower case unsubscripted or super- 
scripted letters. Scalar product is • ; ||x|[^= x • x. 

c. Scalars are subscripted lower case letters. 

d. Exceptions to these rules are i, j, k, 1, v, n, 
which are used as summation indices or 
scalars; s which is a complex scalar; A(s) 
which is a polynomial in s; and t which denotes 
time. Also and/V-are scalars. 

e. The i^ column of the identity matrix is 
represented by eL 

f. The symbol ~ denotes equality by definition. 

g. The symbol = denotes identity. 
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SUPPLEMENTARY NOTES ON ADAPTIVITY ANALYSIS 


Assume that the control law for 

x = Ax + aiji 


( 1 ) 


has been formed by the optimal methods of the previous section. The 
effects of increases or saturation in the feedback signal or in the actua- 
tors are considered here. In general, let 


♦ =P sat(Hfci). 
If | g.x | ^ p/u, or if p — 00 


ljr « Hg.x . 


(2) 


(3a) 


If | g. x | s p/u or if u — “ 


f sap sgn (g.x), 


(3b) 


and so the possibility of linear and bang-bang control are included 
in (2). 


EFFECT ON STABILITY 

Asymptotic stability for a system 

x = f(x) 


( 4 ) 


is ensured in the domain determined by V(x) < e where V(x) is a 
Liapunov function for (4) and s is a positive constant if 

V (x) < £ V (x) < 0. (5) 
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Now let 


V = ~ x • Bx 


be a Liapunov function for (!)• Thei 


Apply (2) and 


to (7) and obtain 


V = y (Ax + a\|f ) • Bx + ~ x *B (Ax + a\|r) 


= — x • (A B + BA ) x + x *Bai|r . 


— C = BA + A ‘ B - gg*. 


= -Ba 


= - |x.Cx + y (g.x) 2 - p (g.x) sat 


V = - |x«Cx - j |g.x | < 2p sat — 


The control Jr is linear when 


g.x | <1. 


Then (9b) gives 


Y x ,Cx " \ I § ,x I | 1 ) I §* x ij ’ 


and stability is ensured if 


, 1 

T 
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Similarly, the control is saturated when 


jl | g .x| > i. di) 


Then 

V = - |-x.Cx - j |g*x | | 2p - |g.x||, (12) 

and 

| g.x| < 2p ( l3 ) 

is necessary for asymptotic stability. 

To establish sufficient conditions for a region of asymptotic 
stability in this case, consider the lemma 

(x.Ba)^ ^ (x -Bx) (a.Ba), (14a) 


where 

B = B'" > 0, 


(14b) 


a i 0. 


(14c) 


Proof: If x and a are linearly dependent, the equality sign obviously 
holds. Alternatively, if x and a are linearly independent, let 

ui (x.Ba/a.Ba)a, v|x-u?!0. ( 


By direct substitution 


v • Bu = u • Bv - 0 , 


(16) 


and so 


x - Bx = (v + u) • B(v + u) = v»B v + u »Bu > u* Bu. 


(17) 
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Thus by (15) 


x*Bx> (x.Ba) /(a.Ba), 


(18) 


and the lemma is proved. 

Now by (8b) and this lemma, 

I g* x I ^ 2 (x.Bx) (a.Ba). 

Then if 


(19) 


(x-Bx) (a-Ba) <(2p). 


v4x°.Bx° - _ 

2 a • Ba 


2p ' 


( 20 ) 

( 21 ) 


must imply that 


V < 0, 


( 22 ) 


and asympotic stability of (1) with saturated control will be guaranteed 
in the region where 

2 

(23a) 


° n O 4p 

x • Bx •' K 


a • Ba ’ 


or equivalently where 


x«Bx° < - 4p ‘ 


a.g 


(23b) 


(See Table I at the end of this appendix. ) 
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EFFECT ON PERFORMANCE INDEX 


$(x°) 


(x-Cx + (g’x) ) dt 


Since from (9a) 


= ^x.Cx - j (g-x) 2 + p (g.x) sat 


(24 ) becomes 


>(x°) = j | -V + (g.x) 2 - p (g.x) sat ) | dt 


1 O T-j O 

= - X -Bx 


-/ I g.x I jp I sat 

r\ ' 


Thus the performance (in the sense of (24) is not degraded if 


ih{p h mi- m) 


Now, for 


(27 ) is valid if 


^gl x - > i 
P 


g-*| < P 


which implies that p >1. For 


(27) is valid if 


p > 1 


C - 1 4 


which implies that 


g*xj< p |g • x | < p (32) 


Summary of Results 


Always sufficient for system stability 

P > 1/2; 

x • Bx < - 

a.g 

Always sufficient for undegraded 
performance index 

p > 1 ; 

| g • x | ^ P 

Control is pure linear if 

^ |g’ x | 

< P 

Control is bang-bang if 

M- 1 g* x | 

> P 
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Abstract 

This paper extends the work of Wonham and 
Johnson [l] , who found the nature of the optimal 
control on the singular strip for a given quadratic 
performance index. Their solution required a spe- 
cial preliminary transformation to phase coordi- 
nates. In this work the optimal control is found, on 
the singular strip and in a neighborhood thereof, 
without the use of their special transformation. The 
optimal control law off the singular strip takes the 
form sgn cr(x), where cr(x) is a power series in the 
state vector, x. The terms of o-(x) up to and includ- 
ing those of the third order are found. 

Introduction 

t The work [ l] is extended in several ways: 

(i) Avoiding the change from state-variables to 
phase coordinates gives the present work complete 
generality, which is mistakenly claimed by [lj: the 
alleged reduction of the integrand of the quadratic 
performance indexto a nonnegative definite weighted 
sum of squares in [ l] is incorrect, in that some of 
the weighting coefficients may be negative, as 
simple examples show. 

(ii) Computation of the plant's open-loop poles 
is avoided: the "singular control" gain vector is 
derived in terms of quadratic matricial equations 
closely related to those of optimal linear control; 

(iii) The nature of the singular regime (linear) 
control in an (n-l)-dimensional strip near the origin) 
is completely explained by exhibiting a linearly 
switched bang-bang system, optimal near the origin, 
whose chattering regime [2] gives an average motion 
(the Andre-Seibert sliding regime *) which is 
identical with the singular regime; 

(iv) A method for computing the coefficients of 
a multiple power- series in the state -variable s 
which provides the local optimal control switching 
signal as an explicit feedback law is developed. 

In [l], the optimal nonlinear control law is 
described implicitly by means of the familiar 
Hamiltonian Two-Point Boundary- Value Problem 
[4], whereas the present approach leads to an ex- 
P lic ^ solution of the equivalent Hamilton- Jacobi 
equation. 

Principal Results 

Let the system to be controlled have the state- 
vector form 

i = Ax + a* o , x(0)=x°. [A=(A ). a=(a.)] (1) 

where the feedback control law \h - dj (x) must 
satisfy ° ° 

l+o I s 1 (2) 

and, for some free terminal time T. 0 < T < + co, 

x(t) — 0 as t — T, (3) 


while at the same time minimizin g the performance 
index 

T 

* = zf (x-Cx)dt, (C = C*>0) 1 ' (4) 

J 0 

where C is a given po sitive -definite symmetric 
matrix. 

We shall prove that, in a sufficiently small 
neighborhood of x= 0, the optimal feedback control 
is precisely _ - 

= s gn [cr], o-= g. X( (5) 

(where as usual sgn[<r] s cr/|<r|), where the gain 
vector g is defined as follows. 

Let 

P = I n - [l/(a-Ca)]aa*C, (6) 

A 

so that P is a "projection matrix" with the properties 
A2A A A * 

(P) = p, Pa = 0, (P) Ca = 0. (7) 

Let 

B = B* > 0 , det(B) = 0, (8) 

be a non-negative definite, singular symmetric 
matrix satisfying 

B(AP) + (AF)*B - [l/(a-Ca)]B(Aaa*A*)B = 

= - C + [ 1 /(a- Ca)] Caa*C , (9) 

as well as the constraints 


Ba = 0, (10a) 

(Aa)-B(Aa) = - (Aa) • Ca (10b) 


It was established in [ l] that the condition of 
controllability [see (40) below] together with C posi- 
tive definite are sufficient for (9) to have a solution 
B with the properties stated in (10). 


Then the desired g will be given by 
g = - (lA/i7Ci)(BA + C)a , 
which, by (8) and (10a), has as a corollary 
a • g = - \J a • Ca < 0 . 


(Ha) 


(lib) 


It should be noted that, by (lib), and [2], use of 
the control law (5), (11) must always lead to an end 
point x 1 , namely, a time T > 0 and state x 1 such 
that 


g ' x 1 = 0, |(A*g)-x 1 | < -a-g = |ag|, (12a) 

x(T*) = x 1 (12b) 


As first noted by Flugge-Lotz [3], the solution 
x(t) of the system (1), (5), (11) cannot be defined 


*Kliger [1 0] calls 


it the slippage regime . 


tThe notation of this paper will correspond as 
closely as possible to that of [7]. 
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for t>T*, because the relay = sgn[cr] would begin 
to "chatter" atcr = g*x 1 . This 0 difficulty was over- 
come in an elegant theory by Andre and Seibert [Z], 
who assumed a small time -delay t in the relay, 
namely tp(t) = sgn [<r(t - t)] , and derived the limit- 
motion x(t), for 0 < T + <t< + a>, as t — 0. 

It turns out [2] that this sliding motion takes 
place in the hype rplane - strip 

g ■ x = 0, | (A*g) -x| S - a • g , (x = Px), (13) 

and is defined for T + ^t<+°°by 

x = PAx, x(T„) = x 1 , (14) 

P = I n - [l/(a-g)]ag*, (15a) 

Pa = 0, P*g = 0 . (15b) 


Also, by (14) and (15b), 


_a_ 

dt 

(g • x) = g • X = g • PAx = (P*g) • Ax = 0 , 

(23) 

so that g 

■ x 1 = 0 implies that 



g • x(t) = 0 , (T* < t < + co) . 

(24) 

Multiply (22) on the left by x* and on the right by x, 

and note 

that, on g • x = 0, 



= x • Bx . 

(25) 

By (14), 

(25) implies 

= x • (BPA + A* P*B )x = -x • Cx , 

(26) 

whence, 

integrating, one obtains 



x(t) • Bx(t) = x * • Bx * - frj, (x • Cx) dt , 

(27) 


Note, however, by (15a), that 
PA = A - [ 1 / (a - g)]ag*A = A + a(-[l/(a- g)]A*g)* (16) 

and that, by (13), ( | A*g • x | / 1 a • g | ) S 1. 

Hence the sliding regime can be regarded (and, 
using dual -mode control , synthesized), as a linear 
control system of the form 

x = Ax + a$ Q , g • x = 0 , x(T + ) = x* (17a) 

= q • x , |$ q | < 1 , (17b) 

q= -A*g/(a ■ g) +>tg ( 17c ) 

- #* < X< ** 5 

We shall prove that the system (17) is asymptoti - 
calh r stable on g ■ x = 0, and that 

f +<3 ° 11 1 

$ = (x • Cx ) dt = x • Bx , g - x =0 (18) 

where B is given by (9) - (10), and where the feed- 

back law $ 0 = q • x actually minimizes under the 
constraints |$ 0 |<1, g*xl=0. Furthermore it will 
be proved that (17) is identical with the singular 
regime ofWonhamand Johnson. [ADDED IN PROOF. 
Since this paper was accepted for presentation, the 
comments [ 1 0] of Kliger have appeared. Kliger 
makes a statement similar to point (iii) above, con- 
cerning implementation of the singular regime by 
means of a chattering regime. However, he does 
not mention the Andre -Seibert theory (14) - (15), 
and fails to prove the all-important results (lib) that 
a • g < 0 and that the system (17) is asymptotically 
stable on g-x = 0, which will follow from (22) below; 
the arguments of [ 10] do no more than prove that if 
a • g < 0, the system (17) has end -points [2, 3] which 
is nece ssary for stability but not sufficient. ] 


Firstly, rewrite (11) as 


(a-g)g = (BA + C)a , (a-g) = a • Ca 


Now, using (19), and inserting (6) into (9), re- 
arrange (9) to show its equivalence with 

BA + A*B = -C + gg* . 

By ( 10a) and ( 1 6), 

BPA = BA . 

Hence (20) can be expressed as 


B(PA) + (PAfB = -C + gg* 


(19) 

( 20 ) 
( 21 ) 

( 22 ) 


which shows that, on (24), x(t)-*0 as t-*+®* This 
proves (18). Tne minimality of (18) was proved by 
Wonham and Johnson; hence, it remains only to 
identify (17) with their singular regime, which can 
be done by comparing (18) and (19) with the equa- 
tions (23), (27), and (35) of [ 1 ] . 


By (19) and (17c), ± 

q = -[ 1 / (a ■ g)]A*^=*-[l/(a • g)r(A BA + A C)a A (28) 

Hence, using (20) after multiplying on the right by 
A, (28) gives 

(a • Ca)q = -(A*BA + A*C)a + Xg(a.' C<t) = 

= (BA 2 + CA - A*C)a - (g • Aa)g+j{rf(29) 

or O 


(a • Ca)q = (BA 2 + CA - A*C)a 


5 


(30) 


- ( /<VCa (31) 

But (31) is a consequence of (10b) and (19). Hence, 
(29) holds. The equations (19) and (30) give g and q 
according to [l], while the preceding argument has 
shown their consistency with (17c). 

It is easy to give a direct proof that (17), (19), 
(22), (30), (31) correspond to singular control. By 
(1) and (4), and the Maximum Principle [4], define 
a Hamiltonian by 

H- = x • A*y + (a- y)0 o - • Cx . (32) 


g'Aa = 4 .- 


The Hamiltonian canonical (variational) equations 
associated with (32) are 


k = Ax + a$ Q = grad (y) #, 

(33a) 

y = -A* y + Cx = -grad (x) /¥-, y(T + ) = y 1 . 

(33b) 

Singular control occurs when = 0 by virtue of, 

separately, 

a . y = 0 , (34a) 

x • A* y = lx- Cx. 

(34b) 

Now assume that 


y = -Bx , (a • y 1 = o , Ba = 0) . 

(35) 

Clearly a • y = -a • Bx = -(Ba) - x = 0. 



Similarly, by (20) and (35), equation (34b) holds 
on the strip (13). But we have already proved that 
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Y Q = q-x implies that the system (33a) is asymptoti- 
cally stable on (13). Furthermore, by (31), (19), 

‘ and (30), equations (33a, b) and (35) imply that 

a * y = (a • g)(g-x) , (36a) 

a • y = [(a-Ca)q - (BA 2 + CA - A*C)a] x = 0 . (36b) 

Hence g • x 1 = 0 implies that a • y = 0, whence (35) is 
in fact a solution of (33a, b)-(34a, b) for $ - q • x. 

Optimal trajectories outside of the singular 
strip (13) can be obtained by the flooding technique , 
as noted in [l]. Since application of the results of 
[1] require a special coordinate system, whereas 
the present formulation is completely general, the 
flooding procedure will be described in the present 
notation. (A discretized version of flooding is well 
known as Dynamic Programming [5]. ) Since a • y is 
to vanish only at isolated times, the Maximum 
Pi iple [4] is applicable. The optimal trajec- 
toixes leading to the singular strip are generated by 
starting on the strip and integrating the Hamiltonian 
(canonical) equations backwards in time. If the 
terminal state xl is an arbitrary point on the 
singular strip, then the corresponding terminal co - 
state yl = -Bxl is known by the preceding charac- 
terization of the matrix B. The (optimized) 
Hamiltonian is therefore 

U = x-A*y + |a-y| - jx-Cx, (37a) 

where the result 

4j q = sgn[a • y] (37b) 

is a consequence of a * y i 0; now integrate 

-x = Ax + a sgn [a • y] = grad^?¥, x(0) = x 1 , (37c ) 

-y= -A*y+Cx= -grad (x) ?f , y(0) = y 1 = -Bx\ (37d) 

for Os t < + co. Every state x(t) attained in this man- 
ner will have as its co -state the associated y(t), and 
the optimal control value 4 i Q = sgn[a ■ y(t )] . 

The preceding flooding method (37) is just a 
technique for solving the Hamilton -Jacobi partial 
differential equation, W = 0, by the method of 
characteristics. In fact, outside of the singular 


strip one has 

= sgn [a • y] = -sgn [(a * grad $>)] (38a) 

y = -g ra ^ x j$ , $ = $(x) , (38b) 

H = -Ax • grad 4> + |a • grad $| - }x-Cxi 0, (38c) 

These equations can be re-written in the form 
(Ax + a« o ) • grad $ = -[x-Cx, (39a) 

€ o = ~ s S n f a * g rad > ( c o = D , (39b) 

grad $ = Bx when g. x = 0, | A*g • x | < | a • g | (39c ) 

where, in the notation of stability theory, (39a) is 
equivalent to 

i = “ 2 X ■ Cx , (39d) 


namely, $ is a po sitive -definite Liapunov function 
whose Lie derivative is the negative -definite function 
(Vz)x • Cx, and where the integration of the partial 
differential equations (39a) - (39b) is to be per- 
formed subject to the boundary conditions (39c). 

Numerous publications in this field have stated 
that explicit solution of (39) is a '’hopeless” task. 


However, by using some new results of Bass [6] 

(see also [7] - [9] ), the partial differential equation 
(39) can be solved explicitly in a neighborhood of 
x = 0, as will be shown. 

The computation of certain auxiliary vectors 
and matrices is a preliminary step. 

Define the controllability matrix (Kalman) by 

D = (a, Aa, A 2 a, • ■ • , A n "*a) (40) 

and assume, as was done implicitly in assuming 
solubility of (9) - (10), that det D£0. Then a vector 
b exists which is defined by 

b = (D’Ve 11 , (D*b = e 11 = (0, 0, • • 0, 1)*) . (41) 

By definition, b has the property that b-Ai-^a = 
[(A*)i-l b ]. a = 6 in . (6 nn 4l;6. n 4 0, iVn.) 

It can be shown [ 7 ] that if one defines a phase 
variable ©i by setting 

0j=b-x, (eW = d i 0j/dt i = [(A*) i b] -X , 

(i = 0, 1, • • • ,n-l)) (42) 

then the system (1) is equivalent to 
n 

A(d/dt)0 ] = = 4 > q , (43) 

i=0 

(which is in terms of the phase -coordinates 0j, 

0 1 1 [ n - 1 ] , instead of the state variables 

xj, • • • , x n ) where the oq are defined by 

n 

A(s) = det(sl n - A) = ^o.s 1 , (44) 

i=0 

and where the inverse of the change of variables (42) 
is given explicitly [7] by 

n 

x= {r(d/dt)ej}a S ^ef-^s.a , (45) 

i= 1 
n 

r(s) = ^ s 1 ’ . (46) 

i= 1 

Here, if denotes Laplace transform, and s the 
complex Laplace variable, the polynomial A(s) is 
the open-loop characteristic polynomial of ( 1 ), and 
the matrix T(s) is the numerator of the open -loop 
matrix transfer function G(s), which is given by 

G(s)MsI n - A)' 1 =£{e At } =gf{ , (47) 

where the theoretical definition of the matrices S is 

i 

n 

S i = , (i = 1, 2, • • * , n) . (48) 

j = i 

The definition (44) requires n! multiplications and 
for large n cannot be used to compute oq. However, 
the coefficients aq and matrices Sj can be computed 
in about n 4 multiplications* by the algorithm t : 

*For example, a Hughes computer subroutine finds 
( Q v Sj) for a 10 X 10 matrix in about 5 seconds of IBM 
7094 time. T Leverrier (1840); cf. [7]. 
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a = 1 , S = I , (49a) 

n n n 

Vr- n/J,trace(AS n-j+l ) 1 S n-j = ft n-j I n + AS n-j+l 1 

(j = 1,2, (49b) 

whose accuracy can be checked by the tfact that 
S Q = 0 should hold (Cayley-Hamilton theorem). 

Now define vector transfer functions v(s), u(s) 
by 

n n 

v(s) = T*(s)b = ^ ^ s 1 lfc> = 

i= 1 k=i 

= S ( S 0 k sk " j ) <A * ,:i ' lb ’ <50) 

j= Ak=j ' 

n n , 

u(s) = ns)a/A(s) = 2, Z>A(I)J 0 j AJ a = 
i=l j=i 

= i( i-xO*'- 1 * • 

j= l' k=j 7 

and note that (by the Cayley-Hamilton theorem which 
gives (sl^ * A)T(s) = A(s)I n ), the following results 
are identities: 

A*v(s) = sv(s ) - A(s)b , Au(s) = su(s) - a , (52a) 
v(s) • a = 1 , u( s ) • b = 1 / A(s ) . (52b) 

Also, it can be proved [7] that 

D' 1 s (a,Aa,...,A n ' 1 a)' 1 = (S*b, • • • , S*b) * , (53) 


b-A^a = p._ n , (j = 1, 2, 3, — ) . (59) 

Define a new set of state variables 4>i = 4>i(x), 

(i = 1, 2, • • • , n), by 

D *x = 4>2» ‘ ■ • » 4> n )* » (60a) 

and note that by (53) and (42), 
n 

x= Y 4>.A* *a , 4 1 - = (S*b)*x , 0 1 = 4> ♦ (60b) 

/ . i i 1 n 

i= 1 

Further note that by (46), (50), (53) and (60a), 

n 

£ o (s) = v(s)-x= 1 * 

i=l 


Since s ic an arbitrary tumjjlex variaule, (61) is 
equivalent to the set of conditions obtained by 
equating the coefficients of like powers of s, i. e. , 
(61) is just a condensed statement of (60b). 

Now multiply (1) scalarly by v(s) and use (52a) 
and (42) in order to verify that if x = x(t) satisfies 
(1), then i Q = t Q {s, t) = v(s) • x(t) satisfies 

d£ (s)/dt = si Q {s) + ip Q - A(s)4> n . (62a) 

Again, (62) is just a condensed statement of the 
differential equations 

4>, = -ex d> + , (62b) 

1 on o 

4> = d>. - a . .<J> , (i = 2, 3, • • • , n) , (62c) 

i l-l l- I n 

obtained by equating coefficients of like powers of 

s . 


and, analogously, 

(b,A*b, •••,(A*) n ‘ 1 b)" 1 = (Sja, ..-,S n a)* . (54) 

Hence, if the vector transfer function w(s) is defined 
by 

w(s) = (S ^a, • • ■ , S^a)*v(s) , (55) 

it will be true that [multiply (50) by (54)] 



where the e^ are the fundamental unit vectors 
Oh = (e 1, • ■ • , e n )). 

Next, compute a sequence of numbers (Pj} 


recursively by 



P = 0 , {v = 1,2, .. 

-v 

■,n-l); P Q = 1 , 

(57a) 

v-l 



S = - y a. p. , 

v Lu i+n 

i=0 

(v = 1, 2, • • • , n) , 

(57b) 

n+ v - 1 



S = - y a p. 

n+v zA l-v l 

i= v 

, (w = 1,2,3. •••) , 

(57c) 

and note the resultant identities [7], [8] 


CD 

1/A(s) = p jS - (n+ j>, (for 

j=o 

| s | > p Q defined by ( 66)) 

.(58) 


The motivation for the preceding derivation of 
(62a) is that, in the special case when the roots 
^1’ * ’ * >^ n = ^ are distinct , one can define 

v X = v(\.) , u 1 = {[ A(s)/A f (s)]u(s)} g _ x , 

1 i 

(i = 1, 2, • ■ • , n) , (62d) 

= v 1 • x = |(\.) , (62e) 

and obtain from (52), 

A^v 1 = v 1 , v 1 • a = 1 ; Au 1 = k.u 1 , 
i 1 • 

u 1 • b = 1/A'(k.) , (i = 1. 2, ■ ,n) (62f) 

while (62a) becomes the Lur 1 e canonical fo rm 

f. = \.£. + if- , (i = 1, 2, • ■ * , n) . (62g) 

b i 1*1 o 

Thus, (62a) is a generalization of the Lur'e canoni- 
cal form, valid whether the roots of A(s) are 
distinct or not. 

Next, assume that 4 j q is piecewise constant, 
and, in particular that 

dj = € , c 2 = 1 , (c = +1 or c = -1) . (63) 

Y o o * o o o 

If £ 0 satisfies (62), (63), it will henceforth be called 
£ Q = 4 0 (s;e 0 ) . Define a function 

k = x(s, l o ) = (c Q /s) log [ 1 + < 0 s£ 0 (s;c o )] , (64) 
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and note that k is analytic in for 

IUI1 < i/Po^tPo) . I s | < p Q , 


and note that the crj(x;€) are analytic in x on (65). 
Using (58) and (68), it is easy to prove by the 
(65a) calculus of residues that 



For future reference, choose 


(65b) 


p > || A || {> max IxJ , A(\.)=0). (66) 

i= 1, • • • , n 

Referring to the n new state variables = (S*b)»x 
of (60) and (62b, c), note that they can be related to 
the state variables x* and phase coordinates 
0 j[i- 1] } (i = 1, 2, • - ' , n) by the following explicit and 
uniquely invertible transformations [7j , 

n 

4>i = ^ a.Q , (i = 1, 2, • • * , n) , (67a) 

j=l 

n n 

x= J 4^A* *a = ^ 0 ^ ^ S.a , (67b) 

i= 1 i= 1 

i- 1 

eI l i_ll = I P jV n-i+1 ’ (i = 1.2. . (670 

j=0 

and that the function k(s,£ q ) can be [8] expressed in 
terms of the 4>i = 4>i(x) as follows. Define o)^ = 
oj j(x, € o ) recursively by 

Wj = 4>j , (68a) 

v-1 

€ O 

“r+vT},l 1 ' ' = 

j=l 

V- 1 

= +„ ’ {v = 2 ’ 3 ’’"’ n) (68b) 

j=l 


e o 

“n+, = - (n + V * j K+v-j*j = 

j=l 

n+v - 1 

= - y ju.<t> . . , (v = 1,2,3.- 

n + v J j n+v-j 

)- v 

Then it can be proved [6], [7], [8] that 


). (68c) 


k( s,£ (s;e 
v ^ o' o 


)) = ( e Q / s) log [ 1 + e o s^ o (s;€ o )] 


co 
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(68d) 


Now we are in a position to define certain very 
important functions oj = crj(x;€ o ) by 


c r.(x;e ) = } ,(x,€ ) = 

j ’o' Z* i i+n-j+1' o' 

i=0 

= e^" 1 ^ + o(||x|| 2 ) = 

= [(A*)j‘ X b] . x-i€ o (x*QjX) + 0(|| x || 3 ) , 
Q. = (A*) j_1 Q 1 , Qj = (D " 1 )*ED* 1 , 

where the i,j— element of E is defined by 
e 1 • E e j = P. + . _ n , (i, j = 1, 2, • • • , n) . 

When the are distinct, 


n 



Now define the nonlinear vector function 
p = p( x ;« 0 ) 


(70a) 

(70b) 

(70c) 

(70d) 

(70e) 


by 

p = p(x;e o ) = (<r 1 (x;€ o ), •• •, <r n (x;e o ))* , (71) 

and note that 

p = p(x;e o )= <b,A*b, •••,(A*) n ' 1 b)*x + 0(||x|| 2 ) . (72) 

Consequently, the transformation 

cr=p(x;€ o ), or = (o^, o-^, * * * , <r n )* » ( ? 3) 

has a unique inverse 

x = h(o-;€ o ) = (S^a, • • * , + ° ( II * II ) » (74) 

for all || x || sufficiently small. It can be shown [8] 
that this inverse is given explicitly by 


x = h(cr;€ ) = 


2ttnTI 


— {exp[e Q w(s ) • cr] - l}u(s)ds = 

! l=p„ s 


i 

2tt\/-T 



and that the transformations (73) - (74) are reci- 
procal for all x on (65), i. e. , that 


x = h(p(x;« o );« o ) 


cr = p(h(<r;c o );« o ) 


(76) 


0 . = o-.(x;< ) = r 
j j' o' 2tt v-1 


s | = P 


r J - 1 1 

for all ||x || 

lA(s)I' <(s ^o (s;e o ))dS ' 

proved [7] 


o 

(j = 1,2, 


, n) , 


(69) 


for all ||x||< 1/p v(p ). Furthermore, it can be 


det (h (0; e)) = det(D) , (77) 
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and 


which re-emphasizes the fact that the condition of 
controllability det (D) t 0 plays an essential role in 
the construction of (69) - (71), and (75) as reciprocal 
transformations; in other words, controllability is 
sufficient for the functions oj = (rj(x;e Q ) of (69) - (70) 
to be "functionally independent". 

The significance of the cr.'s is that a^, cr^, • * • , 
<J n _j are first integrals of ^ 

x = Ax + a€ Q , ( e o = 1 ) (78) 

while cr n is an isochrone [8] . That is, by sub- 
stituting (78) - or its equivalent, (62) - into (64) and 
(69), it is easy to verify that 

|0, j = 1, 2, • • • , n- 1 

<r.(x;e ) = dcr.(x;c )/dt = € 6, = { (79) 

y ° y ° ° Jn |i, j = n . 

Another interpretation of (79) is the equivalence 


x = Ax + a€ Q , x — h ( c ) ,<^=> o- = e^e , <r = p(x). (8 0) 

In other words, the nonlinear change of state 
variables 

x. = h.{v y , • • • , tr ) , cr. = p.(x;e ) , 
l Pi n* o' l o 7 

(i = 1, 2, • • • ,n) , (81) 

"rectifies" the phase -portrait of (78) for ||x || < 

1/Po v(p 0 ) by transforming the "streamlines" of 
(78) into parallel straight lines. 

Using (80), it is possible to solve the Hamilton- 
Jacobi equation 

i = (Ax + ae ) ■ grad, <J> = -'I'(x) , $(0) = 0 , (8 2) 

__ o (x) 

by noting its equivalence to 

i = t^e 11 • grad^$ = - ^{h (cr ) ) , <£(0) = 0 , (83a) 


and 

= q *x , q = -{a * g)’ X A*g^for T + < t < + co , 
then [integrating (82) for 0 < t < T + and adding (18)] 

/- +CO 

$ = $(x°) = / [x(t)*Cx(t)l dt (86a^ 

“ 0 

is an expression for the solution of 

<j> = (Ax + a^ Q ) * grad^$ = - (i/ 2 )x • Cx (8 6b) 

in a neighborhood of the points {x(t) | 0 £ t < + 00 } . 
Hence (by the "Principle of Optimality" [5]) 

^(x 1 ) = $(x(T + )) = (i/zjx 1 • Bx 1 (87) 

and so (8 5) must have the boundary values 
<£(x) = (l/z)x • Bx, when g ■ x = 0 , 

| A*g • x | < | a • g | . (88) 

By (74) and = I n , 

x = h( ( r 1 , ••• ,o- n ) = (S l a)<r ] + • •• + (S n . 1 a)o- n _i + a<r n + 

+ 0(||p|| 2 ) , (89) 

whence, by ( 1 lb) 

g -X = (g • SjaJcrp • • • +(g • * (s/a • £*)% + 

+ 0(||p|| 2 ). (90) 

Since a • Ca i 0, the standard expression for the 
reversion of power series applies to give an analytic 

function $> = $ ( cr. , • * • , a . ) such that 

n n 1 n - 1 


g * x = 0 • 


j = $ (cr ♦ • • , cr . ) , (91a) 

n n 1 n - 1 


a n - [(g • Sja)/>/a • Ca]<Tj + * ■ • +[(g ■ s n . ! a )Na * Ca]cr n _ + 


3${cr , * * • , <r )/9cr = -€ ^(h(o . , • * * , tr )) . (83b) 

1 n n o 1 n 


In the present case, T' = (V 2 )x * Cx. Hence the 
general solution of (83) is [clearly 3$ 0 /3<r n = 0] 

= $> + , (8 Z 
o 1 

$ = $ ( cr cr • • • , <r ) , $>, = (cr. , * • * , o ) (8 Z 

o o 1 2 n-1 1 11 n 


*i s -< ,/2) ^J [h( V ‘’-Vr 2 n )-Ch <V 


where is an arbitrary function . 

It remains only to specify 3> 0 = <J> 0 ( cr l > * * * » ^n- l) 
in order to have found the solution of (82) as 

* = * 0 ('l< x; «o ,< ‘"' ,r n - 1 ( x:t 0 )) + 

+ $ 1 ( (r 1 ( x i € Q )» * * * » o* n (x;c o )) . (85) 

However, the preceding theory of the singular 
strip has shown [(1) - (37)] that if 

4> = 0 (x) = « for 0 < t < T* , and 

o o o * 

g*x(T) = °, I A* g • x ( T ) | < | a • g j , 


+ 0( j| cr - c^e 11 II ) - (91b) 

Hence if || x || < min ( l/p 0 v(p 0 ), | a ■ g|/|| A*g || ), the 
desired function $ 0 is [by (88) and (91)] given 
explicitly by 

® 0 = (>A)h(<r 1 ,---,<r n . 1 ,® n )-Bh(<r 1 ,-,<r n _ 1 , * n > + 

• *l ( V"' ,r n-l**n ) - <92) 

Using (84) and (92), we may define an analytic 
function 

tr = o- (x;t ) = a • grad. , $ = $+<!>, (93) 

o o v o' B (x) o 1 

such that, by the Maximum Principle, in the regions 

c 4 0 it will be true that 
o 

e = -sgn[cr (x;€ )] , («^ = 1) . (94) 

o & L o o o 

Note that cr 0 is a multiple power -serie s jointly 
in the (n + 1) variables € 0 and xj; because e Q 2 = 1, the 
series for a Q can be collected into the sum of two 
series having the form 

cr = cr (x;e )= cr (x) + c cr (x) , (95) 

o o o o o o 

where cr 0 (x) and <7 0 (x) are analytic functions of x, 
independent of € 0 . If the inequality 

-<o<po<x)|£ < 96 > 
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defines a region which contains a neighborhood of 
x = 0 (i. e. , || x || < y q , for some y Q > 0), then in this 
neighborhood (with its intersection with the singu- 
lar strip deleted) the optimal control law will be 
given by 

6 0 = - sgn[<? 0 (x)] . (97) 

An alternative approach to finding the switch- 
ing function makes use of the fact that, outside of 
the singular strip , the switching surface must be a 
first integral of (78171:0 r an appropriate e = ± 1. 
Hence the surface must be given by brancRes of 

$(x;€ q ) = , <r n ^(x^)) = 0, (98) 

A A 

where $> = $(z. , • • • , z n _j) is a suitable analytic func- 
tion. (Just use (8 2), with ^ = 0, to get 6 = 0. ) The 
function 6 can be determined from the obvious 
boundary condition that the set of a\ such that 

* (< V"> <r n-l ) = 0 - ' ' ' ' *n ] (99a) 

must contain the set ("edges" of the singular strip) 


Conclusions and Epilogue 

The properties of the optimal control in a 
neighborhood have been described. This control is 
obtained by using certain closed form nonlinear 
transformations. The method is an analytical ver- 
sion of obtaining optimal trajectories off the singu- 
lar strip by the method of flooding. It should be 
emphasized that the solution to the problem pre- 
sented is local in nature and could be investigated by 
simulation to find out empirically its global validity . 

The authors have recently discovered how to 
find the optimal control for stable plants off the 
singular strip for performance indices of the form 
T 

/ + 2l »dt, 

0 

where 4^(x)>0, v=2,***, and4>^(px)= p 2 V ijj^(x). 

That is, are positive semi -definite homo 

geneous multinomial forms of degree 2v. It is 
interesting to note that the optimal control off the 
strip in this case is of the form 


or 

n 


: V°i* 


(A*g) • h(cr^, • • • •0' n . 1 -(r n ) = ± (a • g) . 


-sgn[a-grad (x) <t> 2i/ (x)] 


(99b) 


Hence we can choose 


(A*g)-h(o- 1 , • ■ Mr n l , <S n (<r 1 ,---,o n _ 1 ))±(a-g). 

( 100 ) 

The use of (93) - (97) will now be illustrated by 
an explicit power series expansion through terms 
cubic in the x.. 

l 

Using (74), (91b), and (70a), we have from 
(93) and (54) 

°o = e " g rad (<r ) 4 = 9 V 0 °- n = * t.WlvO)* 


= -M« 0 I ^[a-S*CS a]<r.<r +0( 
i=l j=l 


Ml 3 ) 


- or 4 e (? 
o o o 


( 101 ) 


where [after some algebraic manipulations] 

5 = - (V^x-Cx + 0( ||x II 3 ) , (102) 


= - ^(x-Q.x)([CS.a]-x) + 0(||x|| 4 ). (103) 


i= 1 

Assuming now that the lowest order terms de- 
termine the relative signs of cr Q and it is clear 
from (93) - (97) that 

[ n 

< = sgn 


^ (x *Q.x)([CS.a] -x) 


i= 1 


whenever 

x ‘ Cx <2| 


^ (x ■ Q.x)([ CS.a]- x) 


i=l 


(104) 


(105) 


where is a positive semi-definite homoge- 

neous multinomial form. That is, the argument of 
sgn consists of only one term of a power series and 
not an entire power series. These topics will be 
discussed in a forthcoming article. 
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ABSTRACT 

FOR 

OPTIMAL NONLINEAR FEEDBACK CONTROL DERIVED FROM 
QUARTIC AND HIGHER-ORDER PERFORMANCE CRITERIA* 

by 

R. W. Bass and R. F. Webber 


as minimization of quadratic performance criteria leads to 
linear feedback, so it is shown here that minimization of integrals con- 
taining quartic or hexadic terms in the state variables leads, respectively 
to cubic or quintic feedback. This idea is extended to the minimization ’ 
of integrals of arbitrarily higher order combinations of the state variables, 
which is desirable in order to impose inequality constraints upon the state 

variables. Such laws are shown to be adaptive to actuator saturation 

(including even bang-bang operation). These results are proved by 
exhibiting a closed-form solution of the corresponding Hamilton- Jacobi 
equation, which also provides a globally valid Liapunov function. Prior 
results of Kalman, Haussler and Rekasius appear as special cases. A 
new constructive procedure for computing the coefficients of the higher 
order feedback terms is also presented, together with a numerical appli- 
cation which illustrates remarkable effectiveness in the reduction of 
overshoots as compared to optimal linear control. 
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OPTIMAL NONLINEAR FEEDBACK CONTROL DERIVED FROM 
QUARTIC AND HIGHER-ORDER PERFORMANCE CRITERIA* 

by 

R. W. Bass 

University of Colorado and Hughes Aircraft Company 
Culver City, California, U.S.A. 
and 

R. F. Webber 
Hughes Aircraft Company 
Culver City, California, U.S.A. 


Introduction 

The problem of state-vector feedback control 
of autonomous, completely controllable linear 
plants is considered. It seems possible to 
generalize the following results to multi-channel 
controllers, but here only a single control vari- 
able will be considered. The results derived 
herein are a natural generalization of results of 
Kalnutu- for quadratic performance criteria and 
of results of Haussler 7 and Rekasius 8 for quartic 
performance criteria. 

The present point of view is somewhat differ- 
ent from that of Haussler and Rekasius. Whereas 
they seek to minimize a quartic criterion subject 
to a mean- square constraint on the amplitude of 
the control variable, we impose an additional 
mean-square-amplitude constraint, namely on 
what turns out to be the nonlinear feedback part 
of the control variable. To this problem an exact 
(not merely "sub-optimal") solution is obtained. 

By noting that the lower-bound of a nonnegative , 
quantity in the present work is zero, The 
Haussler-Rekasius quartic upper -bound follows 
from the present results, while their lower- 
bound in this context is a consequence of the 
well-known results on quadratic criteria. There- 
fore the Haussler-Rekasius results on quartic 
criteria constitute a genuine corollary of the 
present completely general results. 

The present generalization does not seem to 
be trivial, however. Firstly, the method 7 * 8 of 
regarding a quartic form of degree n as a sum of 
N= (n+2)(n+3)/41 squares of quadratic forms 
seems to us algebraically awkward and more 
cumbersome to apply numerically than the 
present technique, as well as unsuited to exten- 
sion to hexadic and octic forms. Secondly, 
although the first part of our Theorem 1 can be 
derived using the Haussler-Rekasius approach?* 8 , 
their measure of "sub-optimality" seems to us 
unconvincing because for arbitrarily large initial 
conditions not only the absolute difference $ - | 
between their upper and lower bounds on the per- 
formance criterion $ (namely f £ $ £ $) can be 
made arbitrarily large, but even the percentage 
difference [($/#} - 1 ] can be made arbitrarily 
large; and so the formal reason advanced by them 
for choosing such a control can be made arbi- 
trarily irrelevant (despite their excellent success 
in a numerical example 8 ). In fact, the striking 
success of the numerical examples given by 
Rekasius 8 for n= 2 and by ourselves below for 
n = 3 seem to be interpretable more conveniently 
in terms of an optimality attained than a "sub- 
optimality" which turned out to be better quanti- 
tatively than one had any previous, rigorously 
valid reason to expect. 


* Work performed under NASA Contract NAS 8-1 14 21. 


Practical Motivation 

This investigation was motivated by a desire 
to consider the minimax criterion of optimality, 
namely . 

min max cp(x(t) ) t 1 ) 

♦ t 

where cp(x) denotes a positive Hefirvite scalar fur.c 
tion, x the state vector, t time and t|J the control 
to be chosen. In practice this criterion may be 
approximated by the criterion 


r +co 

/ [- 

J 0 


for large integers V. 

Correspondingly, one is led to the general 
problem of minimizing performance criteria of 
the type 


J n 


where ¥ is a finite or infinite sum of positive- 
definite homogeneous multinomial forms of 
degree 2 V, (V=l, 2, 3, • • • ). which constitutes 
the subject of this paper. 

Notation will be established, certain known 
results reviewed, and certain constructions of 
multinomial forms defined. Principal results are 
stated in the form of two theorems, whose proofs 
are given in Appendix 1. An effective numerical 
procedure (leading to a computer -oriented system 
design technique) for finding the required coeffi- 
cients of higher-order forms is derived in 
Appendix 2. This design procedure is applied to 
a third-order numerical example and the results 
of a computer simulation of the resulting system 
are presented in Appendix 3. Conclusions follow 
the main text. 

Preliminaries 

Vectors are nXl columns unless otherwise 
stated; vector or matrix transposition is denoted 
by * and scalar product by * ; thus, the 

Euclidean norm 1 1 x 1 1 2 = x* x = x x. Equality by 
definition is denoted by A. . 

The performance index to be minimized is of 


the type 


= J ^ +0 ° Y dt defined in (3) above, with 


00 

■ 


v 2 = X-Cx 


(C = C* >0) 


is a given positive -definite homogeneous quad- 
ratic form, and where each ^ 2 v = ^ 2v (x) is a 
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positive semi-definite homogeneous multinomial 
form of degree 2v, (v = 2, 3, 4, • • • ). (In other 
words, ^ 2 v(x) s 0 , and ’^vtMx) =|a 2v ^2v(x) for all 
x and all n ^ 0. ) 

The system evolves in time according to 
x = Ax+af , x(0) = x° , (• =d/dt) 

( 6 ) 

where x is the system state vector , A is the n Xn 
plant matrix , a is the actuator vector , and is 
the scalar control law to be chosen in feedback 
form if = i|/(x) . It is assumed throughout that (6) is 
controllable , 3 i n the sense that the vectors A* - la, 
(i= 1, 2, • • • , n), are linearly independent. Con- 
trol laws are admissable only if they produce 
asymptotic stability of the equilibrium state 
x = 0; in particular, it is required that 

x(t) 0 as t -> + co (7) 

This stability will be established by explicit con- 
struction of a Liapunov function V = V(x), of the 
form 

CO 

v = X (zv) *2V - < 8 > 

V=1 

where 

cp 2 ^ x-Bx , (B = B* > 0) , (9) 

is a positive -definite quadratic form, where each 
= cp 2 v(x), is a positive semi- definite homoge- 
neous multinomial form of degree 2v, (v=2,3,4, • • •), 
and where Liapunov's stability theory 1» 2 i s 
applicable by virtue of the fact that the Lie 
derivative of V(x) along the vector field (6) is a 
negative-definite function, namely -Y(x) -(Ba-x)^. 
In other words, i|r = if (x) will be so chosen that 
whenever x = x(t) satisfies {6), 


V(x(t)) = - ¥ (x(t)) - [g-x(t)] 2 , 

(10) 

where 


g 1 - Ba . 

(ID 

Note that 



® rad (x) V(x ) = Bx+ Yib) e radc P 2v (x) , 

v= 2 (12) 

whence, using the definitions (11) and 

03 

U = ' X (^) a ’ gradCp 2v • < 13 > 

v =2 

it is clear that the scalar quantity 
00 

CT = - a.grad V = - X ( 2^ ) a> e rad 

v=l (14) 

can be expressed as 

a = g ’ x + ♦ n -t (x) * (15} 

The quantities a and i|i n ^are important in forming 

the optimal control law if, and the definitions 
(13) — (14) and identity (15) will be assumed hence- 
forth and used repeatedly in the sequel without 
further reference. 


then V (x) = ( 1 / 2 v) cp 2 V (x) is defined by 

(8), and the functions a(x) and ^ n £(x) are to be 
focfnd from the definitions (9), (11)- (15). 

The method of computing the fcp2v) from the 
H'2 v) will be prefaced by a special case, namely 
computation of cp 2 = x-Bx from if 2 = x-Cx. This in 
turn will be motivated by reviewing the well- 
known results of Kalman^ regarding linear 
regulators. 

Quadratic Performance Criteria 
Consider now the case where 

* = \ * 2 = \ x-Cx , (16) 

and choose if so as to minimize (3) subject to a 
"mean-square amplitude" constraint on i|i of the 
type 

+ 00 

^ dt ^ pj = const. (17) 

By the Lagrange multiplier technique [absorb the 
multiplier into C, by allowing C to be multiplied 
by any positive scalar without loss of generality] 
the minimization of (3) and (16), subject to the 
constraint (17), can be replaced by the uncon - 
strained minimization over i|/ of 

4- 00 

[x-Cx + » 2 ] dt . 

(18) 

It is well known^ that the solution to the problem 
of choosing if in (6) to minimize the $ of (18) is 
given by 

* = g’ x > <g = -Ba) , (19a) 

min $ = §{x) = i x-Bx , (19b) 

where B = B* > 0 is the unique positive definite 
solution of the (equilibrium) matrix Riccati 
equation 

BA + A*B - Baa* B = -C . (20) 

Inserting (19) into (6) displays the controlled 
system in its "closed-loop form" as a linear 
system 

x = Ax + a = Ax , (21) 

where by definition 

A = A + ag* = A - aa* B , (22) 

and where A is known to be a stability (Hurwitz) 
matrix. On subtracting -Baa* B = -gg* from 
both sides of (20), and defining the positive- 
definite matrix (? by 

c £ C + gg* , (23) 

equation (20) becomes 

BA + A *B = - C , (C = C* > 0) , (24) 

which has the well-known solution^ 

/ + 00 

exp (A*t) C exp (At) dt > 0 . 

u (25) 




To recapitulate, the matrix-vector pair (A, a) 
and the functions {^2v3 are given, while the func- 
tions {cp2\>} are to be constructed by algebraic 
operations upon (A, a) and the coefficients of 


A highly practical, purely algebraic algorithm 
for computing g (without first finding B) is given 
by Bass and Gura4; from g, both A and C can be 
found readily, and then B can be computed from 
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(24) either by the inversion of a matrix of order 
1/2 n(n+ 1) as in Bellman^ (p. 231), or by the 
technique of Appendix 2 below. Alternatively, a 
purely algebraic algorithm for computing B 
directly from (a, A, C) which involves multiply- 
ing a 2n X 2n matrix by itself (n-1) times and then 
inverting a matrix of order n is given by BassL 
Note that, on recalling cp 2 = x-Bx and defining 

? 2 k + 2 ( x ) + (g‘ x > 2 * g = " Ba ’ < 26 > 

the algebraic equation (24) takes the form [just 
premultiply by x* and postmultiply by x] of the 
partial differential equation 

Ax. grad cp 2 (x) = -? 2 (x) . (27) 


A Theorem of Liapunov 

Equation (27) illustrates a classic theorem of 
Liapunov^* 2, which shows that if K is an arbi- 
trary stability matrix, and if il/ 2 v (x) is any posi- 
tive semi -defirvi te Viorr.oger.CGU 3 multinomial form 
of degree 2V ( the partial differential equation 

Ax-grad cp- v (x) = -ty^x) , ( V = 1 , 2, 3, * ■ • ) , 

(28) 

has a unique solution cp 2 v( x ) which is also a posi- 
tive semi-definite homogeneous multinomial form 
of degree 2V. A new practical algorithm for 
solving (28) is given in Appendix 2. Henceforth 
it will be assumed that the [cp 2v ] are constructed 
from the in accordance with(28), for 

v = 2, 3,4 . 

Summary of Algebraic Constructions 

To recapitulate, the pair (A, a) is given 
together with the forms^ [ty 2 v}. FirstB = B(A, a, C) 
is constructed so that A = A - aa* B is a stability 
matrix satisfying (27) with 

~ 2 
cp = x*Bx , 4L = x-Cx + (g-x) 

2 2 (29) 

Then this A and the [^2v ; v - 2, 3, 4, * ♦ • } are 
used to construct the remaining [cp 2v I v =2, 3, 4, • *•} 
so that (28) holds. Now V(x), c(x), and ¥ n £(x) 
can be constructed as in ( 8 ), (13), (14), and will 
henceforth be regarded as known quantities. 


Principal Results 


Consider the choice of ^ in ( 6 ) to effect mini- 
mization of the general $ of (3), subject to the 
constraint (17) and an additional constraint of the 
type 


_L 

2 



[* ni (x( t ))] 2 dt S P 2 = 


const. 


(30) 


The constraint (30) is at this stage admittedly a 
somewhat artificial condition, justified only 
because it permits an explicit, closed-form solu- 
tion of the problem at hand. However, it will 
turn out a posteriori that ’^ n -t(x) happens to agree 
with the nonlinear terms in the optimal feedback 
control law iji(x); hence the physical meaning of 
the two independent constraints (17) and (13) is 
that the "mean-square-amplitudes" of both the 
linear and the nonlinear terms in the optimal con- 
trol law must be a priori bounded separately. 

Once again, the Lagrange multiplier tech- 
nique may be used to formulate an equivalent 
unconstrained problem, namely, that of choosing 
the control law if in ( 6 ) so as to minimize the 
unconstrained performance criterion 


*=*(x‘>= [ ji'(x) + ± v 2 + ± [i n ^(x)] 2 |dt. 

J 0 (31) 

It is important to note that in (17) andp 2 in 
(30) can be chosen independently and arbitrarily. 
At first glance this seems to require an intq^rand 
in (31) of the form ¥ +(1 / 2 )Xj y 2 + (1 / 2 )X 2 • 

However, on replacing y 2 by \\ i|/ 2 , and ’i' 2 v by 
,y \j /\ 2 V 2 v f°r v - 2 , the quantity X 2 y n l 2 is 
replaced by Xj Vn/t 2 - Hence division by Xj yields 
an integrand of the form \\ = X 2 = 1 , in which now 
each 7 y , v s 2 , has been replaced by 
(1 / J Xf X 2 ) i|! 2 v- Thus by letting scalar factors 
multiplying ty 2 and y 2v » v - 2 , run independently 
over all positive values, all constraints P[ and p 2 
will be attained. (In numerical applications of (18) 
it is well known that a factor multiplying C must 
be allowed to vary similarly in order to insure 
attainment of (17).) 


The optimal control law for ( 6 ) relative to 
(31) is given by 

y = a(x) = g-x + ^(x) , (32) 

and, furthermore, 

V(x°) = min $ (x° ) . (33) 

* 

Moreover, the related control law 

= iao (34) 

yields global asymptotic stability of x = 0 for all 

V>\ • ( 35 ) 


Li > - . k > 0 , (36) 

2 

be arbitrary numbers. Choose £ = £(><•) > 0 so 
small that on the neighborhood of x = 0 defined by 

V (x) < e (37) 

the inequality 

|a(x) | <2* (3 8 ) 

holds everywhere. Then the control law 
ill = h sat Lm a/> i] 

yields asymptotic stability of x = 0 on the region 

(37). 

The practical utility of the preceding results 
may be inferred from the application summarized 
in Appendix 3 . 

Conclusions 

A completely general algorithm has been 
presented whereby nonlinear feedback laws can be 
computed. which minimize integral performance 
criteria defined by multinomial forms of higher 
than quadratic order. A criterion of order 2 v 
yields a feedback control law of order 2 v - 1 , 

(v = 1, 2, 3, • • • ). These results represent a 
generalization of the results of Kalman3, 
Haussler^, and Rekasius®. 

Minimax criteria can be approximated more 
and more closely by increasing V; however, it 
does not seem practical to take v very large, 
because there will in general be N = n (n+ 1) • • ■ 

(n + 2 v - 1 ) / ( 2 v) ! distinct nonlinear feedback 
terms which must be mechanized. 


I a such that 


Theorem 2 
Let 
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Practical experience to date indicates very- 
satisfactory results with V = 2. That is, quartic 
crite ria will keep the state variables (or linear 
combinations thereof) very nearly within pre- 
specified allowable bounds, while the required 
cubic feedback control law is feasible to 
mechanize. 


Appendix 1 
Proof of Theorem 1 

The law i|/ = a provides a unique solution to 
the Hamilton- Jacobi equation 

V(x, y, i|r) = tf(x, y) = 0 , (39) 

^(x, y) s max^(x, y, i|f) , y ~ -grad $ 

♦ (40) 

In fact, taking 

y = y* A x+ (a-y) f - Y - -i !|l 2 - A , (41) 

and noting that = a.y - l|f = 0 if and only if 

= a-y = - a-grad $ , (42) 

while d^V/di|r^=-l<0 at y - a -y, one obtains 

V( x , y) = ^(x, y, a-y) . (43) 

Hence (39) becomes, by-(42), 

iV=y.Ax+ ~ \|r 2 A [l|l-g.x] 2 - Y= 

= y-Ax- i|l(g.x)+ If 2 -Ii(i 2 + l(g.x) + 



= y-Ax - t - i (g.x) 2 = 

f 00 > 

= -|i [Ax.gradcp 2+ 'ir 2 ]+ [Ax.gradcp 2 v +* 2v ]j 

= 0 (44) 

by (27)-(28), provided that it is possible to 
identify V and $ and so use 

CO 

y = -grad V = - £ (^) grad cp 2v , 

V=1 (45a) 

* = a-y = a = g . x + ^ . (45b) 

However, comparing (41) and (44), and using (45), 
(39) may be expressed as 

V = x*grad V = - \j + * 2 + j * n \ ] . (46) 

Thus, by Liapunov's direct method, x(t) 0 as 
t +®, and, integrating (46), one obtains the 
result that = a implies V(x°) = $(x°). 

Similarly, upon choosing i|f = \i CT, it can be 
shown that 

V =-[^4'* n , 2 ]-(^-|)a 2 . (47) 

This completes the proof of Theorem 1. 

Proof of Theorem 2 

Assume V(x) < e = e(x) and | o(x) | < 2 k. Then 
it can be shown easily, using V(x) as defined by 
(8) and V = K sat (p a(x)/*), that 

V(x) = -Y(x)+-to 2 (x)-xa(x)satr^a(x)l--iiJ' ni 2 (x) . 

(48) 


Now consider two cases, (i) and (ii). For (i) let 
|(u/*) j(x) | ^ land for (ii) let |(p/H) a(x)| ^ 1. 
Then for (i). 


V = -'i - 

and V < 0 when p 
For (ii), 


1 , 2 

2 V n^ 




(49) 


v = -* t nt 2 + L 2 - h | a | , (50) 

and V < 0 for |a| < 2*-. This completes the 
proof of Theorem 2. 


Appendix 2 

A Theory of Higher Order Forms 

Presented here are techniques for effective 
use of 2 v£h order forms. As explained following 
(28), construction of an optimal control depends 
on solving the equation 

Ax. grad ^ 2v (x) = -'^(x) , (51) 

for ‘p2v( x )- This relation actually represents N 
linear equations in N unknowns. It will be seen 
in the sequel to (58) below that the dimension N is 

Ty T _ n(n+l) • - - (n+2v-l) /c ,, 

N ” (2W 1 . (52) 


The unknowns are the coefficients of the different 
terms in the 2v-th order form Cp2 V ( x ) and the 
knowns are the corresponding coefficients in 
^2v( x )- Thus (28) may be represented by 


where 


b 


O b = c 



(53a) 


(53b) 


and Cl is an N X N matrix. The bi's represent 
coefficients in the unknown cp2v( x ) and the c-j/s 
represent the corresponding coefficients in the 
known ^vlx)- hi order to solve for b it is neces- 
sary, in effect, to invert O. This could be 
accomplished by standard techniques. That is, 
just write out the relationships involved and solve 
for the bi's. This however would require a con- 
siderable amount of algebra even for simple 
problems. For example, if n = 5 and 2v = 4, then 
N = 70. 

As an alternative to solving (53a) in this 
manner, one might use the spectral resolution of 
(2. Thus, seek the eigenfunctions of the 
operator. 

Ax.gra d ( x)< • ) . 

In other words, seek homogeneous multinomial 
forms Gk( x ) degree 2v such that, for (complex) 
eigenvalues p^ , 

Ax-grad C k (x) = p R C k <x) . (54) 


It will be shown that the C k 's can be formed 
from products of linear forms raised to various 
integer powers . This idea will now be presented 
in detail. 
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Let u k be right eigenvectors of A, let v k be 
left eigenvectors of A, and let the corresponding 
eigenvalues be X.^. Then 

Au k = A. u k , (55a 

k 

A*v k = X k v k . (55b 

It will be assumed that the are distinct 

(k = 1, 2, • • * , n) ; then the [u^j, {v^} are linearly 

independent and can be so normalized that 


k j 

u • = o. . 


Expand each term (60) in eigenfunctions 
as follows. Write for x^ k 

m k A , k , m k 
x k = (e -x) 

and then expand e^ in terms of the left eigen- 
vectors of A. That is, expand e^ as 


■ I **'- 1 ■ 


(k, j= N) 


From the theory of matrices one has 


Once the X^’s are known, the calculation of the 
normalized u^'s and v kl s may be easily accom- 
plished, - ^ . g. , using the closed form expressions 
presented by Bass and GuraE 

Define C t(x) b Y 

£,(x) = (v -x) (v -x) (v -x) , 

(57) 

where the rrq^'s are integers determined by 


m n = 2V 


m. t ^ 0 


The expression (58) does not uniquely determine 
the m^'s. Therefore, let be an index corre- 
sponding to each permissible set {m^} . It is 
shown in Malkin^ that there are N such sets, 
where N is given by (52). 

Using (57) straightforward manipulations 
yield 


Ax* grad C . (x) = Ax-grad 


[ ( vl.x) m ^--(v n .x) m ^] = 


~ 1 1 m l£ -1 m n -t 

= (Ax*v 1 )m^(v 1 .x) -...(v n .x) + 

~ 2, / 1 -It 2 v m 2t _1 n v m nt 

+ (Ax-v Jm^v -x) (v .x) ...(v -x) +•••• + 


~ 1 IIX !i 

+ (Ax*v n )m^(v -x) 


m s - 1 
, n v n*C 
■ (v *x) 


1 ^ 1 9 lit jt 

= (m 1 ^X 1 +m 2 ^X 2 +... +m n ^X n )(v‘x) --.(v n *x) n = 


= b^C^(x) . (59a) 

Malkin 2 has shown that by letting the rrq^'s 
range over all permissible values, as given by 
(5 8). one does in fact, exhaust all the eigenvalues 
of the operator Xx-grad( x )( • ). If it is effec- 
tively possible to expand -^2v( x ) the eigenfunc- 
tions iC-t 1 then the equation (51) can be solved for 
q?2v( x ) b y identifying coefficients in eigen- 
expansions. Specifically, if 

N 


,(X) = Y 


Y, C,(x) , 


XV 

< f l 2 v (x * = ^ (Y t/Vl) C 4 (x) 


X = 1 v 1 (uV 


a = (u -e K ) , (i, k= 1, • • • , n) . (63) 

ik 

m k 

Thus, by using (61), (62), and (63), x^ may be 
expressed as 


" k = (e k -x) mk = ^ (u i .e k )(vi.x)[ - (64) 


Recall now that, by (57), the (v^x) are the linear 
forms used to obtain Ci(x). Thus, when (64) is 
put into (60) and multiplied out, there results the 
desired expansion 


**2V (X> = 2 


In practice, expansion of (60), though straight- 
forward in nature, requires considerable sym- 
bolic multiplication of multinomials. 

A Numerical Example 

As an example of the foregoing procedure, 
consider the following case wherein n= 2. Let 

A = ( ^ 3 ) ’ tben tbe e ig e nvalues of A * are 

-2, -1; and the corresponding eigenvectors are 
^ j ^ and ^ 2 j . Now let it be desired to solve the 
equation Ax-grad Cp^(x) = -^(x) and let ^(x) = 

( x i + x 2 ) 4 . Then the C k 's and ^k' 8 are g iven b Y 


Ci = <x 1 + 


UjL = -8 = (-2)4 + (- 1)(0) 


(x 1 + x^) (2x^ + x 2 ) , p 2 =-7 , 


c 3 = (x x + x 2 ) 2 (2x 1 + x 2 ) 2 


C 4 ^ X 1 x 2^ 2x 1 "I x 2^ ' 


M 3 =-6 , 


M 4 = -5 


C 5 = (Zx 1 + x 2 ) 


b 5 = -4 . 


Solving for the coefficients in the eigen-expansion 
of Cp 4 (x) yields 

VAx) = i (xj + x 2 ) 4 . 


Begin by assuming, for a typical term of 

V < X) * rn x m 2 m n 

x — x , constant. (60) 


An Alternative Procedure 

In equations (57), (60)-(64), and (65) a 
general method was presented for expanding 
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-^2( x ) in eigenfunctions. Sometimes it is easier 
to accomplish this expansion directly without 
recourse to the right eigenvectors {u^} of A, 
which are needed if ( 63 ) is used. Again an 
example provides a convenient means of illustrat- 
ing this. Let 

^(x) = Xj 2 x 2 + x 2 ’ 

and let the eigenfunctions be the same as in the 
previous example. Then it is only necessary to 
write X| and x^ in terms of the linear forms 
(x| + x£) and (2x| + x 2 ). The proper expansions 
are 

x 1= (2x : + x 2 )-( Xl + x 2 ) , x 2 = 2(x x + x 2 )-(2xj+ x 2 ) . 

Define 

Xj + x 2 ^ a , 2xj + x 2 ^ 6 . 

Then 

5 

* 4 (X) = (g-a) 2 (2a- 0) 2 + (2a- g) 4 = - ^ y^ • 

i=l 

Expanding this expression in a, p and noting that 
= a 4 , C 4 = a 3 6 
e 2 = a 2 e 2 , s 5 = ae 3 



yields the desired coefficients Yj, Y 2 > • • ■ , Y^- 
Appendix 3 

Simulated Example of Stability Augmentation 
by Cubic Feedback 

Consider the system 



x 3 = -6Xj -Ux 2 -6x 3 + * n4 (x) . 

If we let xi represent position, then x 2 and 
X3 represent velocity and acceleration, respec- 
tively. The object is to choose the feedback con- 
trol t n £(x) so that large overshoots in velocity or 
acceleration are avoided when the initial displace- 
ment is Xl (0) = x 0 , x 2 (0) = 0 and x 3 (0) = 0. 

As the system returns to the origin X2 
(velocity) or X3 (acceleration) may be prohibi- 
tively large. It is necessary to apply nonlinear 
feedback in an appropriate manner to reduce the 
offending state. 


To accomplish this, we consider the per- 
formance indexes and ^ where 


and 


*2 = 



- V l 
2 


iv? 


] 

] 


dt 

dt . 


Minimization of $1 or $2 can he effected by cubic 
feedback where ^(nx) = p 3 i|f n £(x), and 


where lJJ n £ is defined by Theorem 1 and is com- 
putable as in Appendix 2 . 

The feedback control derived from ^ 
will keep x 2 small, and the control derived 
from $2 will keep X3 small. In Figure 1 the 
phase-plane plot of X2 versus x 3 is shown. 
Included in this figure is the response of the 
stable linear system. The initial conditions for 

the responses are x(0) = ^0 j and x(0) = ^ 0 j . 

By examining this plot the reduction in overshoot 
of X£ and X3 becomes apparent. 



x 


2 


Figure 1. Linear and Non-linear 
Feedback Comparison 
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APPENDIX F 


CONTROLLABILITY 


DEFINITION 

The system 


x = Ax + ai^ , x(0) = x° (F-l) 

is said to be controllable if for every initial state x°, there is a control 
law ^ = ^(t) such that the solution x(t) of (F-l) satisfies x(T) = x 1 where 
x is arbitrary and T > 0. 

Theorem . A necessary and sufficient condition for the system 
(F-l) to be controllable is that 


1 

det(a, Aa, * * * , A a) = det(D) * 0 (F-2) 

Proof 

Part I - Necessity . (If det(D) = 0 there is an x 1 such that no 
control law ip(t) can transfer the system (F-l) from some x° to x 1 . ) 

In general, the solution of (F-l) is 

r ^ 

x(t) = exp (At)x° + / exp A(t - X)laijj(\)d\ (F-3) 

o 

At x(T) = x 1 

r T 

x 1 - exp (AT)x° = J exp |a(T - \)]ai|;(\)d\ (F-4) 

o 


F-l 



Now since 


exp 


(AM = 2 

k = 0 


A k ^ k 


(F-5) 


(F-4) becomes 


exp (-AT)x 


1 


o 


x 


k=0 




x k 


(F-6) 


Now if 


det(a, Aa, •••, A n *a) = 0 , (F-7) 

the system of equations 

(a, Aa, A n-1 a)*q = 0 (F-8) 

has a solution q ^ 0. Thus there is a vector q such that 

q • A 1_1 a = 0 (i = 1, 2, • • • ) (F-9) 

Note that (F-9) is valid for all i > n since by the Cayley-Haminton 
Theorem A^(j > n) can always be expressed as a polynomial in powers 
of A less than n - 1. 

By (F- 6) 


q • (exp (-AT)x' - x°) = 0 
But this is incompatible with the choice 

x^ = exp (AT)x° + q 


(F- 10) 


(F- 11) 


F-2 


since (F-10) would then imply 


q • q = 0 q * 0 . (F- 12) 

Thus the system (F-l) cannot be controllable if det(D) = 0. 

Part II — Sufficiency. (If det(D) ^ 0 there is always a way of picking a 
control to transfer the system (F-l) from x° to x^). 

Choose 


4j(t) = a • y(t) 

where y(t) is defined by the solution of 

y = -A' y , y(0) = y° 


(F- 13) 


(F-14) 


Clearly 


y 


exp (-A t)y 


(F- 1 5) 


and so 


4i(t) = a • y(t) = [exp (-AT)aj • y° (F-l 6) 

Thus (F-4) becomes 


exp (-AT)x 


1 


o 


X 



(F- 17) 


Now define a matrix P by 



Then (F-17) becomes 


Py° = exp (-AT)x 1 - x° 

If det(P) 5 * 0, the desired control law described in 
completely determined since then 

y = P exp (-AT)x - x 

To consider this possibility, note from (F-18) that 


(F- 19) 

(F- 1 3) - (F- 1 4) will be 


(F- 20) 


z • Pz 


/(* • exp (-A \)z ^d\. 


(F-21) 


Obviously, if 


a • exp (-A z) ^ 0 (F-22) 

then z • Pz > 0 and P must be invertible. (The determinant of a matrix 
is equal to the product of its eigenvalues and since P must have positive 
eigenvalues det(P) & 0 . ) 

Assume that 


a • exp (-A \)z = 0 , z ^0 (F-23) 

Then by repeated differentiations with respect to \ 

(A^ h) • exp (-A \)z = 0 , (j = 1, 2, • • • , n) (F-24) 

Now since [exp (-A ?c)] ^ = exp (A * X) always exists, exp (-A \)z = 0 
can only be valid of z = 0. Since this is ruled out by hypothesis, 
exp (-A \)z ^ 0 and (F-24) can hold only if 

det(a, Aa, ••*, A n_ h) = 0 . (F-25) 


F-4 


Thus if (F-25) is ruled out, P > 0 and (F-20) is valid, thus proving the 
theorem. 

OBSERVABILITY 
Theorem. If 


X = Ax , x(0) = x° * 0 


rank 


H , A'H , (A ) Z H', - (A"') 


*.n- 1 


H = n 


Then 


(F-26) 
(F- 27) 



Proof. Assume 


Hx|| = 0 , x% 0 


This implies that 


Hx = 0 


H f£=o 

H = 0 
dt 


(F- 28) 


(F- 29) 


(F- 30) 


,n- 1 

S-0 


dt 


n-1 


However, since the solution of (F-26) is 


x = exp (At)x^ 


(F-31) 


F-5 



(F-30) becomes 


H exp (At)x° - 0 
HA exp (At)x° - 0 

HA 2 exp (At)x° = 0 (F-32) 


HA n ^ exp (At)x° --- 0 

If (F-29) is true then (F-32) must be valid for 0 < t < co. At t = 0, then, 


Hx° = 0 


HAx° = 0 


HA 2 x° = 0 

(F-33) 


ha"- 1 * 0 = 0 

(Note: It is now apparent that there is no need to check derivatives of 
x higher than (d n " 1 x)/(dt n " 1 ), for by the Cayley- Hamilton Theorem 
A^ (k > n) can be found as a linear combination of A'' (j = 0, 1, 2, * * * * 
n-1), and if x, (dx)/(dt), •••, (d n_1 x)/(dt) are identically zero, 

(d ■^x)/(dt^), (k > n) must also be identically zero. ) 

The equations in (F-33) can all be satisfied by a vector x ^ 0 if 
and only if 

(F- 34) 


rank 


H 

HA 
2 


HA 


HA 


n-1 


F-6 


Thus if 


rank 


«.V O.* O j, 

«V T* m / >,C 

H , A H , (A TH , 


I A \ 


>: Sn-L 


= n 


(F- 35) 


the assumption (F-29) is false and the theorem is proven. 
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APPENDIX G 


ULTRAMINIMAX CONTROL 


Ucrivcition of the control law that ceuscs q • x to decay exponen- 
tially from an initial perturbation. 

Theorem I . For the system 

x = Ax + aij; , x(0) = x° (G-la) 

+ = S ■ x (G- lb) 

the relationship 

(q • x) = (q • x°) e _|Xt (G-2) 

for arbitrary q and p holds, if and only if 


T * a * 0 (G- 3a) 

_ _ (pi + A*)q (G- 3b) 

5 q • a 

Furthermore, the closed loop system 

x = Ax + a(g • x) = Ax (G-4) 

IS asymptotically stable if and only if (q * r (s)a/q- aj is Hurwitz. 

Proof. Using (G-4) 


d (q ' x ) _ l A : 

dt " I 


q + (q . a)gj 


X 


(G-5) 


G-l 



However, if (G-Z) is to hold 

^ =-,«!• x) 

Combining (G~5) and (G~6) gives 

J A ' q + (q • a)g j • x = - p(q • x) 


(G-6) 


(G-7) 


This can be valid tor all x if and only if 

_ (H-I ± A> )q (G-8) 

3 q • a 

Using this control it is possible that q • x can decay according to (G-2), 
while other system variables will grow without bound. To avoid this 
difficulty, the characteristic equation of the closed loop system must be 
checked for unstable roots before accepting (G-8) as a useful control 
law. From Appendix C the closed loop characteristic equation for (G-4) 
is given by 

A(s) = A(s) - g • T(s)a (G-9) 


Applying (G-8) gives 

A(s) = A(s) + q • (pi + A)r(s)a/q • a (G-10) 


Now since 


(si - A) -1 = r(s)/A(s) 


(G- 11a) 


or equivalently, 


A T(s) = sT(s) - A(s)I 


(G-llb) 



Then (G-10) becomes 


A(s) = A(s) +3-: H- r (s)a + l.:,. _ sr ( s )a 
q • a q • a 


A(s) 


q * a 
q • a 


(G- 1 2a) 


or 


A(s) = (s + p) (G-lZb) 

Thus (G-8) is useless unless (q • r(s)a)/(q • a) is Hurwitz. 

Theorem II . Choosing 

^ - g • x in (G-la) so as to minimize 



+ (g • x) 2 


dt 


(G- 1 3) 


as p -~co with q arbitrary results in a stable closed loop system iden- 
tical to that requiring 


q • x = (q • x°) e" ^ (G-14) 

if q * r(s)a is Hurwitz (i. e. , ultraminimax control is the same as 
optimal control in the sense of minimizing (G-13) as (jl — co). 

Proof . By Appendix C, minimizing (G-13) gives 

0 = A(s) A( - s) = A(s) A(-s) + H-^q * 

Assume A(s) A(-s) is polynomial of degree 
is a polynomial of degree 2m where 

m < n - 1 


r(s)a^q • F(-s)a) (G-15) 

2n and ^q • r(s)a)^q • r(-s)a) 

(G- 1 6) 
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Obviously, as p — ►oo, 2m roots of (G-15) approach those of 


0 = (q • r(s)a^q • F(-s)a) 


(G- 17) 


The remaining 2n - 2m roots are determined as follows. 
F rom (G- 1 5) 


A(s) A(-s) 


(q * r(s)a) (q • F(-s)a 


= -h 


(G- 1 8) 


By long division this can be expressed as 


2n-2m , . 2n-2m-l . . . 

3 + V + '-' + hn-2m 


, . -1 , . -2m 2 

+ .. . . s + • • • + X 9 s = -p 

2n-^m+l 2n 


(G- 19) 


where the X's are constants. Dividing through by s^ n and using 

the complex variable notation 


2 k iu 
-p = e e 


(G-20) 


(G- 1 9) becomes 


1 + \ 1 s" 1 + 


+ X. ~ s 
2n 


■ 2n 


k iir 

e e 

Zn-Zm 


(G-21) 


Now if 


, . 1/Zn-Zm 

s = (e k e 1Tr ) (G- 22) 

(G-21) is satisfied as e k — < ► co. Thus 2n-2m roots of (G-15) are given by 
the solutions of 


2n-2m , 2 

s + p 


= 0 


(G-23 
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In general then, the roots of (G-15) are given by the roots of 

0 = (s 2n 2m + p Z ^q • F(s)a^q • F(-s)aj 

If q • T(s)a is Hurwitz and m = n - 1 

0 = A(s) = (s + p)^q • r(s)a) 

is the closed loop characteristic equation of the stable optimal system. 
This agrees exactly with the ultraminimax system for which 


(G-24) 


(G-25) 


q 


X = (q • x°) 


-fit 

e 


(G-26) 


Remark . The question arises as to what adjustments can be 
made if q • r (s)a fails to be Hurwitz. Consider the equation 


(q * F(s)aj^q • r(-s)a) = 0 (G-27) 

It is clear that m roots of this equation must lie in the left half of the 
complex plane. From these roots generate the Hurwitz polynomial 


h 


I 


a. 

l 


i=0 


i-1 

s 


(G-28) 


where = 1, and = 0 for i > m. In general, (G-27) will not 
coincide identically with q • r(s)a. 

Now let 

°i = q-S i a (G-29) 

where q can be determined from 

n 

q=2]« i ( A V ) 1_1 b (G-30) 

i=l 
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This relationship follows from the identity 



A b, 


(A*) n ' 1 b)(S 1 a, S 2 a, •••, S^f = I (G-31) 


which implies 


n 

q = Iq = ^ (i • S.a)(A :: V" 1 b (G-32) 

i=l 

for any vector q. From (G-28) then, 
n n 

cn s^ - '*' = ^ (q • s.a)S* ^ = q • r(s)a (G-33) 

i=0 i=0 

Thus when q * r(s)a is not Hurwitz, there exists a vector q such that 
the polynomial q • F(s)a is Hurv/itz. Furthermore, by the results 
derived in Theorem II, the characteristic equation for a closed loop 
system minimizing the integral 



J [(q * x) 2 + (g * x ) 



(G- 34) 


is 


(s + p)^q • r(s)a^ = 0 (G-35) 

This guarantees that 

q • x = (q . x°) e ^ (G-36) 

for all x°. Note that the system for which (G-35) holds will also 
minimize (G-13). In a least squares sense, then, q * x is the "closest" 


G-6 


approximation to q • x which can decay exponentially in a stable closed 
loop system. 


G-7 
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ABSTRACT 

FOR 

CANONICAL FORMS FOR CONTROLLABLE SYSTEMS WITH 
APPLICATIONS TO OPTIMAL NONLINEAR FEEDBACK 

by 

R. W. Bass and I. Gura 


Using the assumption of controllability, explicit closed form trans- 
formations among four linear canonical forms useful in control system 
analyses are derived. The relationships found can be easily programmed 
for efficient numerical computation and are also helpful in obtaining further 
theoretical results. Indeed, these formula are basic in establishing the 
properties of a nonlinear canonical form for bang-bang systems, which on 
each side of the switching surface rectifies the state-space phase portrait 
of the given system into parallel straight lines. This transformation, in 
turn, permits direct integration of the Hamilton-Jacobi partial differential 
equation. Furthermore, the feedback law for the classical time-optimal 
control problem is shown to have the form of an infinite series of fractional 
powers of the nonlinear canonical variables. 
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Notational Conventions 

a. Matrices are upper case Roman letters. 

b. Vectors are lower case unsubscripted or 
superscripted letters. 

c. Scalars are Greek letters and all subscripted 
lower case letters. 

d. Exceptions to these rules are i, j, k, -t, V, n 
which are used as summation indices or 
scalars; T(s) which is a matrix polynomial; s 
which is a complex scalar; A{s) which is a 
polynomial in s ; t which denotes time; and o, 

5, 0, Cp which are vectors . 

e. Asterisks (*) denote matrix transposition. 

f. The i** 1 column of the identity matrix is 
represented by e 1 . 

g. The symbol 4 denotes equality by definition. 

h. Unless otherwise stated, indices will range 
over the set 1, 2, . . . , n. 

Introduction 

In the analysis and design of control systems 
for autonomous linear plants, the utility of 
simple explicit transformations between the given 
state variables and certain canonical forms is 
well known. 

It has been shown by Lur'e [l], Letov [2], 
and many others, that use of Lur'e coordinates 
facilitates explicit construction of Liapunov func- 
tions [3], thus advancing the study of stability of 
equilibrium in dynamical systems. 

More recently it has been shown by Bass, 
Lewis and Mendelson [ 4 ], [5], by Wonham and 
Johnson [6], [?], [8], by Kalman [ 9 ], and by 
Bass, Gura and Webber [lO], [ 1 1 ] that use of 
phase coordinates permits the fruitful application 
of frequency-domain concepts to various prob- 
lems of system stabilization and optimization 
originally stated in terms of time -domain 
concepts. 

In this paper a system of generalized Lur'e 
coordinates is introduced. Unlike the Lur'e 
coordinates, these variables are well-defined 
even if the system's "open-loop poles" (i. e. , the 
plant's eigenvalues or characteristic roots) are 
not distinct. Although many realistic engineering 
problems do not have multiple roots, numerous 
highly illuminating examples of modern control 
theory can be derived readily when such roots are 
permitted. Therefore, the complete generality of 
applicability of this last-mentioned coordinate 
system is important for both exposition and 
research on advanced control problems. 

It will be demonstrated below that in both 
theoretical research and practical design proce- 
dures it is rewarding to be able to pass freely 
between the above-mentioned coordinate systems 
and the state -space of the given problem. Twelve 
different linear transformations are needed. 
Unfortunately, certain key inverse transforma- 
tions have not been available hitherto in explicit 
closed form . It has been assumed in previous 


control work that matrices involved are to be 
inverted numerically, and thus the needed coef- 
ficients were then only defined implicitly. This 
has led to awkward circumlocutions {e.g., [6], 
[9])and the desirability of closed form algebraic 
expressions for the inverses has been widely 
recognized. Attempts [8], [l2~l *t deriving such 
expressions in the past have involved unnecessary 
assumptions (e. g. , distinct eigenvalues) and their 
practical use would (unnecessarily) require 
computation of both eigenvalues and eigenvectors; 
in addition, these results have no theoretical 
utility. Partial objectives of this work are to 

1. permit most efficient numerical evalua- 
tion of the desired inverses; and to 

2. yield theoretical results and new alge- 
braic identities which have facilitated solution of 
control problems that hitherto appeared formida- 
ble, if not intractable. 

InPart I below, closed form expressions for 
all transformations are displayed in systematic 
arrays. These formulae have been programmed 
for digital computation and used in the design of 
an advanced attitude stabilization system for non- 
rigid aeroballistic vehicles which were "flown" 
successfully in computer -simulations [ 1 3 ] • 

Furthermore, some of the new algebraic 
identities established in Part I have been used in 
roving various new theoretical results([ 1 0] , 
ll], LI 3], [14] where the identities are stated 
but not proved). For example, use of phase 
variables in [lO] supplies a direct design proce- 
dure which is the inverse of the (indirect) root- 
locus approach. 

A new and evidently important nonlinear 
transformation, together with its explicit inverse, 
is introduced in Part II by making free use of the 
linear canonical forms. This transformation 
renders trivial the integration of the Hamilton- 
Jacobi equation pertaining to "bang-bang" optimal 
feedback control. In fact, the state-space phase- 
portrait on each side of the switching surface is 
transformed explicitly into a "rectified" flow 
along parallel straight lines. 

The nonlinear canonical form also permits a 
constructive solution of the celebrated time - 
optimal feedback regulator problem. It is shown 
in Pa’rt III that the general time optimal switching 
function embodies three features noted in the low- 
dimensional special cases previously solved; 
namely, the solution is an analytic function of 
fractional powers of the system's first integrals 
which can be generated on-line by means of 
logarithmic amplifiers. 

Applications to minimization of quartic and 
higher order performance indices are also 
considered. 

The system to be studied in this paper is of 
the type 

x = Ax + a| (1) 
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where 


Part I. Linear Canonical Forms 


x = Ax (2) 

governs the evolution in time of the uncontrolled 
plant, where the letter a denotes the actuator 
vector , and where the scalar function d = d(x) 
denotes the feedback control law . In general, the 
solution of the system of differential equations (1) 
involves the transition matrix e At , whose Laplace 
transform is the resolvent matrix (si - A) -1 
where I is the identity matrix and s is a complex 
scalar. It can be shown [ 4 ], [ 1 5] that this 
matrix is given by 

(sI - A > _1 = SI (3 > 

where 

n n 

A(s) = det(sl - A) = (Xjsj , r(s) = ^ s 1 ~ 1 S i> {4} 

j-0 i=l 

and the Sj, S 2 , ...» S and the a Q , aj, . . . , a n 
are effectively computable by the recursion 
relations 

a n = S n = 1 ■ (5a) 


a n i = "T trace ( As , 1 ), S .=a .1 + AS . . . 

n 'J J n-j+r' n-j n-j n-j + 1 

(5b) 

The matrices can be shown [ 4 ] to satisfy 
n 

S n-j = £ a.A^j . (50 

i=n-j 1 


T he controllability criterion of Kalman [ 9 ] 
is fundamental to the present analysis and will be 
assumed henceforth. For the system (1) it can be 
expressed in determinantal form as 


det D / 0 , D = (a, Aa, . . . , A n_1 a) . (6) 

Certainly, if (1) i s controllable, the system of 
simultaneous linear equations 

a- b = 0, Aa* b = 0 , .... A** _1 a- b = 0, . . . , 

A n " 2 a-b=0, A n_1 a-b=l (?) 

must have a unique vector b ^ 0 for its solution. 
The vector b can be computed by Gaussian 
elimination. In general, computing b represents 
(l/n) th of the arithmetic labor required to invert 
an n X n matrix. The key inverse matrix desired 
has columns (A' l ')^"^bj elementary recursive 
formulae then supply the other matrices directly. 

The vector b is quite remarkable for several 
reasons. In addition to supplying all five canoni- 
cal forms presented here, it is fundamentally 
related to the magnitude of the linear feedback 
signals required to force (1) to behave in any 
arbitrary manner [l0]. 

Furthermore, the vector b is the normal 
vector at x = 0 to the time -optimal switching sur- 
faxe of the given control problem. In fact, it will 
be proved that near x = 0 the time -optimal regu- 
lator law has the form 

^ = “ sgn [b* x + P (x) ] (8) 

where [p(x)/ || x || ] -» 0 as || x || ->0; thus at x=0 
the surface b»x = 0 is the tangent hyperplane of 
the surface b-x + p(x) = 0. 


In this section there will be established a 
complete set of explicit transformations among 
the canonical forms 


Given state variables: 

x - Ax + ad , 

(9a) 

Phase variables: 

0 = ce + e n d , 

(9b) 

Generalized Lur'e variables: 

cp= C *Cp -t- e 1 d , 

(9c) 

Lur'e variables: 

§ = A? + ud , 

(9d) 


where case (9d) is void unless the characteristic 
roots \i of A are distinct, where C is the com- 
panion matrix to A, namely 


0 

1 

0 


0 

0 

0 

0 

1 


0 

0 

0 

0 

0 


0 

1 j 

_" a 0 

-GLi 

-a 2 

■ • • • 

" a n-2 

^n-i 


and where 

A = (Xl e 1 , X 2 e 2 , . . . , \ n e n ) , u = (1 , 1 , . . . , 1)*. 

(ID 

The forms (9a)-(9c) are real. Since the occur 
in complex conjugate pairs, it will be shown that 
the do also; it is easy to put (9d) into a real 
form in which the complex diagonal matrix A is 
replaced by a real matrix which has 2x2 sub- 
matrices along the main diagonal and in which 
each component of u is either 1 or 0. 

Using symbols to be defined as the outline 
of the derivation proceeds, the desired transfor- 
mations are as follows. 


Coordinate Transformations in 
Vector-Matrix Form 



X 

0 

cp 

UiAj> 

X 

X = X 

X 

u 

CD 

cp = TL v x 

11 

< 

X 

e 

x = DT6 

e = e 

cp = T0 

§ = Z*T 9 

cp 

x= Dcp 

9 = T~h p 

cp = cp 

5 = z 


x=DW? 

0= 

cp = we; 

§ = ? 


Coordinate Transformations in 
Vector-Scalar Form 



All of the transformations depend directly on the 
basic identities 


L- 1 £ [(b. A*b. (A*)"' 1 !,)]- 1 h (S,a,S2a £*>)* 

-1 A T w 1 T 1 (12) 

D = |ja, Aa, . . . , A a)J = (S*b,S|b, . . . .STj)*, 

0 3) 
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( L " 1 ) * = DT , (14) 

where 


a l 

a 2 


a n- 1 

1 

a 2 

a 3 


1 

0 

a n-l 

1 


0 

0 

_1 

0 


0 

0_ 


The inverse of T is 


1 - ^ | ^ a i 6 i-(-v-n| s 

v=0 \ i=max(n -V, 0) / 

and then comparing coefficients of s" V on both 
sides of the equation. Using (18a), (16) can be 
established by direct matrix multiplication of T 
andT” 1 . 

A. Phase Variables (0) 

Consider the output of interest for the sys- 
tem (1) to be 

^ b-x . (22) 


0 

0 

... 0 

i 

0 

0 

... 1 

Bl 

0 

1 

^n-3 

e n -2 

1 

@1 

^n-2 

e n-l_ 


(16) 


By alternately differentiating (22) and applying (1) 
and (7), the relationships 

d 1 ' 1 ^ . . d n 9 1 n 

— - = (A*y~ L b'X , = (A*) b -x+ ill 

dt 1 " 1 dt n (23) 

can be established. Then, multiplying the j th 
derivative of 6i by a:, summing over 
j = 0, 1,2, ... , n, and applying the Cayley- 
Hamilton Theorem gives 


where the 3^ are defined by the Laurent series 
00 

ar 5 X “sir ’ <l s l >max i x il> ■ < 17 > 

j=0 s 

and can be calculated by the recursion relations 
l -l 

Bo =1 - H = - X “j+n-t 6 ; 1 (t=1 - 2 n) (18a) 

j=0 
•6+n- 1 

W- 2 ■ (^ = 1.2.3. ...) - (18b) 

M 

To prove (12), consider the equivalent form 
e i = (Sia, S 2 a, . . . , 5^)*^*)* ‘ !b, which, under 
row by row expansion and application of (5c) can 
be expressed as 
n+i-j 

Z *k +j -i< A *> k ‘‘ b = hj • (19) 

k=i 


j = 0 


d J 0 

a : — A(d/dt)6j = * . 
J dt J 


(24) 


9 n b y 


Upon defining the state variables 0j, 02» 


Bj = d 1 * 1 Sj/dt 1 ' 1 , (25) 

the n*-* 1 order scalar differential equation (24) can 
be expressed as the first order matrix system (9b). 
On combining (23) with (25), it is obvious that 

e = [b, A*b (A !|! ) n - 1 b]x= L*x . (26) 

Note that applying this directly to (1) and com- 
paring the result with (9b) shows that C = LA(L‘9 . 
The identities of (12), (13), and (14) can be used 
to give the explicit inverse of (26), namely 

n 

x= (L*)' 1 0 = (Sja, S 2 a, . . . , s n a) 9 B^a, x = DT0 . 

i=l (27) 

B . Generalized Lur’e Variables (cp) 


Now from (7) expressed in the form 
6 kn = a-(A«) k - lb , 


( 20 ) 


Let , 

Cp 6 d x = TL :, x 

Then (1) becomes 


(28) 


it is easy to show that (19) is valid for 1 ^ ksn, or 
when j a i. When j<i expand the left side of (19) 
into two parts, the first consisting of the terms 
for which i^k^n, and the second consisting of the 
remaining terms (n < k £ n + i - j). Then by using' 
(20) in the first part, and the Cayley -Hamilton 
Theorem in the second, the proof can be 
completed. 

The identity (14) follows directly from 
explicit expansion of the matrix product DT and 
application of (5c) and (12). Similarly, identity 
(13) comes from the expansion of LT and the use 
of (5c) and (14). 

The relationships (18) can be verified by 
manipulating (17) into the form 


cp = (D -1 AD)cp + D" 1 a* . (29) 

Upon forming the product DC' 1 ', and applying the 
Cayley -Hamilton Theorem to the result, it 
becomes obvious that C >,{ = AD. From (13), 
it can be shown that D“1 a = e , whence (29) 
is equivalent to (9c). Combining (28) and (13) 
gives the inverse transformations 

<Pj = <S*b)-x , 

n 

x = Dtp = (a, Aa A n " 1 a)cp 

i= 1 
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To find the relationship between Cp and 0 apply 
* (27) to (28), obtaining 

cp = T0 , e = T“ j cp . (31) 

The corresponding vector -scalar formulas shown 
in the table above can be derived directly from 
these relations and the basic properties of the Otq 
and The details are somewhat involved but 

quite straightforward. 

C. Lur'e Variables (§) 

Consider the Cp coordinates for a system with 
distinct complex eigenvalues Aq, (i = 1, 2, . . . , n). 
Multiplying both sides of the vector system (9c) 
by the transpose of the Vandermonde Matrix 
Z = (z^, z^, ...» z n ), where 

n 

. i -5V lek . (32) 

k= 1 

and simplifying the result by using A(X^) = 0 
yields 


n n 



Defining a new vector § by 

? I z*cp (34) 

or equivalently, 

n 

?i t , (35) 

j=l 

(33) yields (9d). The inverse of the matrix Z * 
can be shown to be W = (w^w , . . . w n ) where 


Expansion shows the i** 1 column of U to be 


I 


(Xi> J 


A'(Xi) 


S.a 

J 


r(x.) 

= A’(\.) a * 


( 43 ) 


D. An Alternative Generalization of the Lur'e 
Variables (5(s)l 

The identity 


n n 

A(n) - a(m) 5 (ti -m r|l l X a j ^’ 1 (44) 
i=l j = i 

can easily be verified by equating coefficients of 
like powers of T] and pi where these quantities obey 
the commutative and distributive laws of algebra. 
With no loss of generality, r\ can be identified 
with si and |-l with the matrix A. Then, by the 
Cayley-Hamilton Theorem and the definition of 

r< s ), 

A(s)I = (si - A) T(s) . (45) 


Indeed, (3) can be found directly from this rela- 
tionship whenever (si - A)‘l exists. Multiplying 
(45) on the right by the vector a, applying the 
definition 


u(s) 


A r (s)a 
- A(s) 


(46) 


and using (4), it can be seen that, identically in s. 


Au(s) = s u(s) 


(47a) 


«(•)* = ab • (47b) 

Similarly, considering (44) again with A* as fi, 
and using 

v(s) * r*(s)b , (48) 

the identities 


w 1 = TzVa^X.) = £ J a k e k -j +1 , (36) 

j =1 k = j 


A*v(s) = sv(s) - A(s)b 
v(s)*a - 1 

can be derived. 


(49a) 

(49b) 


with A'(X^) denoting the polynomial d(A(s) )/ds 
evaluated at s = X^. Clearly then 

cp = W§, W = (Z*)” 1 . (37) 

The relationships between § and 9, namely 

0 = T -1 W? , (38a) 


Now define 


i A t • 

u _ hm 

p->0 


1 


2tt J^T 


u(s) ds 


|s - Xil=P 
v 1 i v(x t ) = T(X.) b . 


(50a) 


(50b) 


5 = Z*T9 (38b) 

follow from (37), (31), and (34). Details of the 
development of the corresponding vector-scalar 
forms are omitted. 

Combining (30) and (35) the relationship 
between x and § is seen to be 

? = v*x , ?. = Ax , (39) 

where 

n 

V = (v 1 , V 2 , . . . , v n ) , S*b = r*(\ i )b. 

j=l 1 (40) 

Alternatively, from (14), (30), and (34), 

§ = Z'*'TL*x, so that 

V = Z*TL* . (41) 

By (14) and (37), the inverse relationship is 

x = US , U § (Z*TL*)- 1 = DW . (42) 


and note that when the X^ are distinct, 

i EM 

u = A-(Xi) a • 


(50c) 


Applying the contour integral operator of (50a) 
to (47a, b), and inserting s = X^ in (49a, b), one 
obtains, for the case of distinct Xj, 

Au 1 = u 1 , u 1 *b = l/A’(Xi) , (51a) 

aV = X i v i , v i*a = 1 . (51b) 

Furthermore, comparing (50c) with (43), and 
(48) with (40), it becomes clear that the columns 
of U are the eigenvectors of A normalized by the 
scaling requirement u^*b = l/A'(Xi), and that the 
columns of V are the eigenvectors of A* 
normalized by the scaling requirement v**a = 1. 
Since standard digital computer routines do not 
normalize the lengths of the eigenvectors u* and 
v* in this manner, care must be taken to multiply 
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u.i by [ 1 / (u^*b)A' (X^) ] , and to multiply v* by 
[l/{vi-a)] (which is permissible since neither 
denominator vanishes, by the hypotheses of 
controllability and distinct roots). This discovery 
that the Lur'e canonical form is precisely equiva- 
lent to the standard diagonalization procedure 
when normalized as in (51a, b) is practically 
useful in numerical work. 

Note that (39) can now be generalized, using 
(48) and (30), to 


n 

§(s) = v(s)*x = ^ s 1-1 Cp. . (52) 

i= 1 

Then, taking the scalar product of v(s) with the 
system (1) and applying (49a, b), it is found that 

v(s)-x = x*(sv(s) - A(s)b) + i|i . (53) 

Now using (52) and (23), the above becomes 
5(s) - s?(s) - A(s)0j + , 6i = b*x = Cp n . (54) 

In Part II the system (1) will be considered 
in the form (54), which is equivalent to (9c) and 
may be regarded as another generalization of the 
Lur'e canonical form. In fact, when the eigen- 
values of A are distinct, = §(^i), and, setting 
s = Xi in (54), the Lur'e system (9d) is 
recovered. On the other hand, whether or not 
the Xi are distinct, the identity (54), which, in 
appearance, is highly reminiscent of the Lur'e 
form, can be regarded as the collection of n 
differential equations obtained by equating like 
powers of s on the right and left hand sides. 

Then, on inserting (52) into (54) and comparing 
coefficients, the canonical form (9c) can be 
recovered immediately. It is for this reason 
that (9c) was called the "Generalized Lur'e 
Canonical Form." 


Part II. A Nonlinear Canonical Form 

In this section it will be shown that the (real) 
systems 

(€ = ±1) , (55a) 

(e = ±1) , (55b) 

are related near x = G = 0 by the uniquely recip- 
rocal (real) transformations 


x = Ax + ae , 


and 


°j =— hr f IrTf f log [1+es ?< s > ]ds 

2ny7T |s|= P ( ’ 


(56a) 


§(s) = v(s)«x 


X 


1 

2 tt V-T 




n n-v 


/ 7 

exp 


-1 

5 1= P | 


_ v=l 6=0 



u(s) ds, 
(56b) 


where the path of integration is a circle enclosing 
all the roots of A(s) = A(Xj) = 0; that is, P>max | XjJ . 
For systems with distinct eigenvalues, (56a) and 
(56b) become, respectively 


A (x.)j’ 1 < 

j = ZiWlh logCl +e * i?i] 

i= 1 


a» 1 

= V «X 


(57a) 


n 


n n -v 


e 


V V i ui 

-1 

x = 2 J x. 

i=i i 

exp 

i 

£ 2j a v+6 X i a v 

v= 1 6 = 0 


Furthermore, it will be shown that the transfor- 
mation (56a) can always be expressed by an eigen- k. 
function expansion 


= 2 ’ V <S?)- X • (58) 

6 = 0 

where the 06 satisfy (18), and the eigenfunctions 
uu v = iA) v (cp) are multinomials of degree v in cpj, 
cp£, . • . » Cp n , also recursively computable by 

v - 1 

“*1 =cp i ’ “v = *v-| • (V=2 n) ' 

m= 1 (59a) 


iu, — ^ (v+ n -i)cp. jj . , (v = 1 , 2, 3, . . . ). 

v+n v+n i v+n-i 

i-i (59b) 

Note that 0*, = 06(A), and Vj = <Pj(x) =cpj(x; A, a) but 
that the multinomials uu v = w v (cp) depend only on 
the dimension n of the system and therefore can 
be computed and tabulated once and for all. 

The transformation (56a) also can be 
expressed by a power series expansion 


where 


Ql = (D“ 


:<)j- 

1 b-x 

-i e(x .Q. x 

> + .. 

' 

(60a) 

~0 

0 

0 

i 

ef 


0 

0 

1 

pi 

h 


0 

0 

... 01 

e 2 


D“ 1 

1 

01 

... B n _3 

e n-2 

S n-1 


01 

*2 

••• 0n-2 

B n-1 


(60b) 


Q- 


j+1 = 


A 5,c Q- 


(j = 1, 2, ... , n - 1 ) 


(60c) 


In the case of distinct roots X^, alternative 
expressions for the power-series coefficients are 


(A 


.. i_i (X i )- ; 

> b = A v • 


J- 1 


(60d) 


i= 1 


Qj = (A 


<,)J ‘ 1q i = vV)< 


i=l 


(60e) 


The authors have simulated approximately 
time -optimal systems of order n = 2, 3, 4, 5 on 
analog computers by each of the three nonlinear 
canonical form approaches (57a), (58), and (60a), 
and have experience in the numerical use of (18), 
(59a, b), (60b, c), and (60d, e). On combining the 
complex conjugate terms in (57a), it can be seen 
that on-line mechanization of Oj can be effected 
in an analog control-computer using nonlinear 
amplifiers which over a suitable dynamic range 
provide the logarithm, exponential, sine, and 
cosine. Use of solid-state devices of known 
nonlinear characteristics (e. g. , Zener diodes), 
or piece-wise linear approximation of the Gj by 
biased-diode function generators may prevent 
Gj = [ ( A*)j “ 1 b]-x + ... for holding for small 

|| x || . Therefore (60a) is desirable for small 
||x||. However (60a) in the form Gj ^ C(A' ,e )j *b]*x 
does not yield stability in general (unless the 
vector b is "tilted" to compensate for the absent 
quadratic and higher terms^ nor does even the 
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form (7j & [(A*)j~lb]*x - e(x*Qjx) yield asymp- 
totic stability for unstable plants unless Qj is 
modified slightly for similar reasons. The fact 
that the required modification in Qj is less than 
that needed in b suggests that perhaps extension 
of (60a) to include the cubic terms in x would 
constitute a practically adequate (local) mechani- 
zation of (57a). The truncation properties of (58) 
are quite different. Recalling that 0 O = 1, and 
defining p >max|Xq|, it can be shown that as 
p-*0, 3 V “>0 for v = 1, 2, 3, ... . W\en\ l = \ 2 = . . . 

= \ n = 0, = w n _i+i (cp(x) ) and the truncation of 

the series (58) at its first term is rigorously 
valid. 

The nature of the preceding transformations 
depends on the theory of "integrals" and "iso- 
chrones. " A first integral of the n^ order system 


a . 

J 


2tt *f-l\ 


/ 


.j- 1 

ATil 


s?(s) + 6^ | ds 
1 + £s?(s) 


1 

■ 2n yr t 



s^ ^ S j ds 
1 + £s§(s) 


( 64 ) 


Now, by complex integration as P - * 60 , the first 
term of the right side of (64) becomes 



/ 

s | = P 


A(s) 


e 6 . 
jn 


(65) 


while the remaining term can be expressed as 


x = f(x) , x(0) = x° (61) 

is a scalar function £(x) such that 

£[x(t)] s C(x°) » or f(x)*grad C(x) = 0 (62) 

is satisfied along any solution of (61). Geomet- 
rically, (62) defines an integral surface such that 
'any state space trajectory initiating on it must 
remain on it for all t. The term "integral" is 
used interchangeably for the function £(x) and the 
surface C(x) = constant. 

An isochrone is a surface defined by setting 
the scalar function y(x) = constant where y(x) 
satisfies 

YCx(t)] = Y(x°) + t , or f(x)‘grady (x) = 1 . (63) 

The time for points on various trajectories to 
move between fixed isochrones is constant; hence 
the term "isochrone. " Here also, this term can 
refer to either the function Y(x) or the surface 
y(x) - constant. 

The following basic properties of integrals 
and isochrones are readily proved. 

1. Any arbitrary function of integrals is 
also an integral. 

2. Every integral of an nth order system can 
be expressed in terms of any n-1 functionally 
independent integrals in the neighborhood of a 
non -equilibrium point. (Proof is analogous to the one 
of [16], p. 115. ) 

3. The sum of an integral and an isochrone 
is an isochrone. 

4. Every isochrone of an order system 
can be expressed as the sum of an arbitrary 
function of n-1 functionally independent integrals 
and any particular isochrone. 

Clearly, the Qj, a £, ...» a n _j defined by 
(55b) are first integrals of (55a), while a n is an 
isochrone of that system. It will be shown below 
that as a consequence of controllability the CTj, 
a 2» * • * » ^n are indeed functionally independent so 
that all of the above properties apply to these 
functions. The transformations discus sed he re 
can be viewed as methods of generating integrals 
and isochrones for (55a), instead of relationships 
between canonical variables. This alternative 
viewpoint is fundamental to analysis of the time- 
optimal problem. 

A. Transformation from x to J 

Differentiate (56a) and apply (54) to obtain 


9 


2tt JTi 


7=f / sJ_1 I 2 (- 1 ) k[es ?< s >] k I 

'"IsUp (k=o ) 


ds = 0 


( 66 ) 


if | p£(p) (<1 • (Note that the condition | p§(p) |<1 can 
be obtained as a constraint on J | x J | by applying 
(52) to obtain | lx 1 1 <1 /pv(p) where v is the upper 
bound of 1 1 v(s) 1 1 on | s | = p. ) The above result is 
obvious, since the integrand is analytic in s. 

Thus (56a) does indeed yield (55b) when applied 
to (55a). 

B. Transformation from a to x 


The simplest proof of (56b) seems to be that 
in which (57b) is proved first, independently; and 
then used to establish the more general result. 

Consider (57a) and define a vector q such 
that each component is given by 


q i = lo 8 [l + • (67) 


Then (57a) can be expressed in vector- 
matrix form as d = Zq, where Z is the 
Vandermonde Matrix (31). Applying the inverse 
of Z, (36), q = W '"G , or q* = wi*C, and (67) can be 
written as 

= YT j exp [e\ i A , (\ i ) w L -a] -1 j . (68) 

By expanding w 1 as in (36) and rearranging, (68) 
becomes the first desired result (57b). 


Now define a transformation x = h(tf, e) by 
(56b). Using the Calculus of Residues, it is 
clear that (57b) is equivalent when the are 
distinct. Also, for distinct Xq, (56a) and (57a) 
are equivalent. Hence it is certain that (56b) is 
the inverse of (56a) t at least when the are dis- 
tinct. It will now be shown that this proposition 
is valid for all systems, even when the \ ^ are 
non -distinct. To accomplish this, consider (56a) 
in the form CT = p(x; e, A, a ) and define A to be 
simple when the roots of its characteristic poly- 
nomial A(s) are distinct. It is well-known that if 
A is not simple there are simple matrices A Q 
such that || A-A 0 || is arbitrarily small. Thus 
it has been shown that there exists a function 
h(a ; e. A, a), namely (56b) such that h(p(x; e, A, a); 
e, A) ^ h(x;£, A, a) ^x is valid whenever A is sim- 
ple. Now take A non- simple. Let (Av) be a 
sequence such that A v is simple for each v=l , 2, 3, ... 
and such that Av^A as v-»®. Now the integrand 
in (56a) is a continuous function of x, A, a, 
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and e since v(s) is a polynomial in A, a, and 
1/A(s). Recall also that l/A(s) is an infinite 
series in powers of s~l, which converges for 
js|>max(\i), whose coefficients are rational 
functions of A. Thus p(x; e, A, a) is a continuous 
function of all its arguments. Clearly, an analo- 
gous result can be obtained for h{a;e, A, a). Thus 
'nfxje, A, a) is continuous in all arguments and so 
'frfxje, A v , a) -^(x; c, A, a) as v->~. But since 
h(x;e, Av, a) = x, it follows upon taking the limit 
that h(x; e ,‘ A, a) = x. This completes the proof 
of the validity of (56b) as the general inverse of 
(56a). 

C. Expansion of G in Series of Recursively 
Computable Multinomials 

Consider the Taylor expansion 


e log (1 + es£(s) ) 


= y e — -T ER?(s)]j , 


which holds for |es?(s)|<l. Since, by (52), c(s) 
is a polynomial in s, the right side of (69) must 
be an infinite series in s and so 


e log [l + ess(s)] = 


oujsJ , 


V ma 

/ . n-m 


, [ i-t-m- 1 ] 


(i= 1,2,..., n- 1 ) . (74b) 

D. Power Series Expansion of a 

Expressing the integrand of (56a) in a power 
series in 5, and applying the expanded form of 
(38a) and (23), results in 


0. = (A*)j “ 1 1 


Z i'(Xi) X i"i 


+ . . . . (75) 


for |^i?il<l. Define Qj as in (60e) and apply (39) 
to (75) to obtain the quaaratic term® in the foinn 
- 1 /2 C (x-Qjx). The relationship A ;<i Qj = Qj + i 
directly follows from (60e) and (51b). To obtain 
a more explicit representation of Qj, note that 
on using (41) and (14), (60e) '(with j=l) can be 
expressed in the form 

Qj = (D'Ved' 1 , (76a) 


jh^TT) z ‘ (zl) 


where the coefficients uuj, (j = 1,2, 3, . . . ), are to 
be determined. To accomplish this end, differ- 
entiate both sides of (70) with respect to s, apply 
(52) and simplify, obtaining 


n 00 00 (k- 1 , n) 

i= 1 j = l k=2 i=l 


Then, equating like coefficients in (71), the 
recursion relations (59) can be established. Now 
note that, using (70), (56a) can be expressed as 


Then by (32) and the relation 

= y o = 1,2,3,...) 


(obtained by contour integration of y ti — r 
the (v, (j)** 1 element of E is |s|-p S 


V |J 

e *Ee 


Z A'(Xi) : 

i= 1 


(V,M= 1, . . . , n). 

(78) 


Tr./^uir 


CT. = 

1 2TT 


From the series expansion of l/A(s) given in 
(17) and the Calculus of Residues, (72) yields the 
desired result (58). 

Example: the n-Fold Integrator 


The system 


n ^ Jn] 


d Sj / dt 


was treated by Lewis and Mendelson [5] for 
n = 3, 4, but no systematic procedure for calcu- 
lating the integrals and isochrones of (73) was 
given. By application of (58)— (59), it becomes a 
simple matter to do so. Since the characteristic 
equation for (73) is A(s) = s n , a Q = dj = . . . = 
a n-l = Then from (18) it is clear that 3i - 0, 

(l ~ 1 , 2 , 3, . . . ) , and so (58) become s G ■ = j . 

Also, by the vector-scalar relationships between 

? and 0, +•; = 9 n _ i+ j = ,i [n-1] _ (i = j t 2 n ). 

Thus (59) yields 

° n =?i n ' l] . (74a) 


Thus (60a) is verified for systems with distinct 
eigenvalues. To generalize the above proof, note 
that (56a) is analytic in a neighborhood of x= 0, 
and so there must exist vectors -t 1 = ^t 1 (A,a) and 
matrices R^(A, a) such that 

c- = T-j-x - y e (x-R.x) + . . . , (79) 

J c J 

for all A. Furthermore, t 1 (A, a) and R^ (A, a) 
are rational functions of the elements of (A, a). 
But the expressions in (60b, c) are well-defined 
rational functions of (A, a) whether or not A is 
simple, and it has just been proved that 

0 = (aT * 1 b , Rj = (aT^Qj , (80) 

whenever A is simple. Hence by the continuity 
argument used after (68) the relationships (80) 
must remain valid for all matrices A, simple or 


Previously, it was claimed that the elements 
of a are functionally independent at x=0. This 
can be proved by means of the series representa- 
tion for a. The Jacobian Matrix for the trans- 
formation in question is, by (60a), L= (b, A"b, 

... , (A :;: ) n_ lb. From (14), however, det L = det D, 
hence L is not singular if the system (1) is 
controllable . 
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Part III. Optimal Nonlinear Feedback Control 

Imposing an inequality constraint upon the 
control function ’■+ , consider the problem of 
choosing ijr in 

i = Ax + ait , U|si , x (0) = x ° , (81) 

so as to minimize a performance criterion 


$ = *(x°) =/ Y(x)dt , (Y>0ifx^0) , (82) 

•'O 

where the stopping time T = t(x°)s+® is defined 
by x(t) _> 0 as 0£t+T„ 

The Hamilton- Jacobi Equation and Liapunov 
Stability 

Assume that an optimal control law t = ^(x) 
is known, and that ${x) and T (x) are continuously 
differentiable. Obviously (82) is a solution of the 
partial differential equation 

i i (Ax + ai|/)-grad $ = - Y (<0 if xj* 0) , (83) 

because d$(x(t) )/dt = $(x) when x(t) satisfies 
(81). Similarly, if Y (x) and (x) are such that 
(83) has a positive definite solution §{x)>0 if 
x^O, with $ (x) + 00 as j|x||-> + 00 , then either 

there exists a stopping time T, or else (if Y is 
not everywhere continuous) a time T 00 (x°) such 
that the solution of (81) cannot be conventionally 
defined for t>T 00 . (For the theory of "chattering" 
or "afte r-end -point motion" or the "sliding 
regime," see [17].) Note that (83) can be 
expressed as 

V = V(x. y, *) = 0 , V f y • (Ax + a*) - Y(x) . (84) 

y = - grad $(x) . (85) 

Principle of Optimality and the Maximum 
Principle " - " — 

If the problem (81)— (82) has a solution then 
the Maximum Principle, which has been proved 
rigorously [l8] # asserts that as a necessary 
condition there exists, for fixed x° , a function 
y = y (t ) = y(t;x°) such that not only (84) holds, 
but moreover 


be given the value + 1 or - 1 on various portions 
of the set a Q = 0, so that 0 Q = 0 constitutes an 
integral surface. Other problems [ll] allow 
two equally valid alternatives: (i) '1 can be 

defined as a continuous function such that CT Q = 0 
is an integral surface; or (ii) Uf can be regarded 
as zero on a Q = 0, and yet the "chattering 
regime" governed by (88) yields an x(t) identical 
to that of (i). This phenomenon is connected with 
the singular solutions of (81)— (82), along which 
a-y(t) = 0, and singular surfaces of (84)— (86) on 
which a*grad <$(x) = 0. Choosing alternative (ii) 
unifies the two kinds of problems under the 
subject of bang -bang control , wherein 

x = Ax + ae , e = e(x) , e 2 = 1 . (89) 

Denoting (56b) by x = h(a), and defining ^(a) ^ 
$(h(a) ) and Y ( a ) ^ Y (h(a) ), the system (89) 
becomes d = ee n and the equations (84), (85) and 
(88) become 

(ci£/aa n ) = -eY (a) , (90a) 

€ = - sgn [6$/da n ] . (90b) 

In this new form, the main import of the 
Maximum Principle , (90b), is equivalent to a 
much simpler idea, namely that 4 s is a positive 
definite Liapunov function for the bang -bang con- 
trol system (89) which (before chattering) is 
"stable" by virtue of having -Y as its negative 
Lie derivative. Solution of (90) is trivial and 
yields as the general solution of (84)— (86) 

$ = ^(a^x, e), ... , o n _ l (x, e) ) + § 1 (a(x, e) ) , 

(91a) 

r°n 

* l( a ) = - e / Y(h(a 1 , a 2 , . . . , a n _ lf n)) dui , 

■'O 

e 2 = 1 , (91b) 

where = $ 0 ( a i> • • • » a n -l^ is an arbitrary func- 
tion of its n-1 arguments. Assuming $(x) con- 
tinuous, any surface of discontinuity of e (x) is 
constrained by the requirement that $ Q (a(x, -1)) + 
$!(o(x, -1)) = $ 0 (a(x, +1))+ ^(a( X) +l))for xon 
the surface. 

Quadratic Performance Criteria 


V = V(x, y) = 0 , v = max V(x, y, *) . (86) 

UNl 

X = grad (y) V(x, y, ♦) , y = - grad^jVfx, y, (i) . 

(87) 

However, (85) is not claimed to be necessary. 
Starting from the valid Principle of Optimality 
[l9], a formal, heuristic argument indicates that 
(84)— (85)— (86) are both necessary and sufficient. 

But rigorous study of (84) — (87) is difficult. Clearly 
(86) implies that 

^=sgn[a Q (x)] , 0 Q (x) ^ - a*grad $ ^ 0 , (88) 


In [11] it was shown that if Y = 1/2 x-Cx is a 
positive -definite quadratic form, then for x suf- 
ficiently near x = 0 

e = sgn[a 0 (x)] , a Q = -(a n -$ n (a 1 ,a 2 , a n . x )) 

(92) 

for a suitable function $ n . Also there exists a 
non-negative definite matrix B such that, in (91), 

*o = { h < a l ° n -l> $n>- Bh (°l>--- . °n-l> # n) 

- *i(o lt .... d n _ j , * n ) . (93) 


whence there is a hypersurface, a Q = 0, along 
which t(x) is discontinuous; on either side of this 
surface, t is a constant. It is easy to prove that 
if $ satisfies (84)— (85)— (86) in the complement of 
the set a (x) = 0, then the known necessary con- 
dition (87) is a corollary. However, the defini- 
tion of i|f on the set a Q = 0 is difficult, as is the 
extension of the just mentioned result about (87) 
onto the set a Q = 0. In some problems Y must 


Time-Optimal Control 

When Y = 1, the celebrated time-optimal 
problem is obtained. It will be shown here that, 
near x = 0, 

e=sgn[a D (x)] , a Q = - (ctj - $ 2 (a 2 ° n -i)) , . 

AAA A (94a) 

Oi = a £ (x, c). e = s (x) , e Z = 1, (i= 1,2 n-1), 

(94b) 
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(* 2 / |l X II) -* 0 as | | x | | -* 0 , (94c) 

where ^2^2’ • • ■ » dj^_j) .in analytic function of 
fractional powers of its arguments, and where 
e(x) is characterized on and off the surface 
a Q (x) = 0 by 

e = - e , a * 0 , <94d) 

o 

e = e , a = 0 . (94e) 

o 

It is known [ 1 9 ]» C 1 8 ] that for linear controllable 
nth order systems with real eigenvalues, time- 
optimal control can be effected by at most n- 1 
switches of a bang-bang control e. For systems 
with complex eigenvalues, this result remains 
valid for initial conditions sufficiently near the 
origin in state space. Thus the state trajectory 
of (89) originates at x° with a specific e, say 
e Q = e(x°). When x(t) crosses the switching sur- 
face, the system is governed by 

x = Ax - a e (95) 


integral surface a Q = 0 must be expressible in 
the form - $2 ( a 2 » * * • » a n-l^ = w h ere 
$ 2 = o ( | |x | |). 

The gerreral properties (94e) of the auxiliary 
switching function £ = e(x) are obvious. The 
detailed procedure for calculating e(x) and 
$2( a ? , . . . , a n-l) is based upon simplification of 
(100) by means of (56a). First (52), (7), and 
repeated use of (49a), yield 


E(s)=(-l) n ' 1 e X*v (T > 
v=l 


V 

s - 


A(s)])mM a *) a) s' 

k = 1 


v - 1 


,j- k . 
( 102 ) 


Then, with (69) and the Calculus of Residues, 
(56a) becomes 


a. 

J 


2" 


JTi 


f feU 


(-Hi; 


Is | = 


j = l 




during the next arc of the trajectory. Thus, the 
optimal switching surface for (89) is an integral 
of (95), which therefore must be some function of 

CT 1, °n- 1 * 

The solution of (95) is 


i-D"- 1 < 


2 


u 


<¥>( 7 ) 


ds 


or equivalently, 


v=l 

if | s? (s) |< 1, 


(103) 


At 

x (t ) = e x 


4‘ 


e e A(t ^> adtx 


(96) 


If x 1 is on the switching surface, then 


At. 


n-2 


0 = e 


n - 1 xi y { - i) 

j = 0 


j+1 


f 


u j 


‘j+i 


A Vr M > 


adn 


(97) 

where t Q is the time at which x(t) enters the sur- 
face, where t i( t 2 , ■ . . , t n _ 2 are the subsequent 
switching times, and t n _ [ is the stopping time. 
Solving for xl and applying the convenient 
substitution, 

T. ^ -t • , » (j = 0, 1, . . . , n-1) , (98) 

1 “ n-j-1 

yields 

xl=e Z <4 titt Z ( ‘ 1)J [ ( ' T n-j-2 } +l 


v=0 


j=0 


•'•Vh'-V 


(99) 


Thus, taking t Q = T n _ j = 0, the parametric form 
of the switching surface is 


x = x(T) A {-l) n_1 e ^ V v (T) A v_1 a , 


4< T > = T7T 


V=1 

j=l 


( 100 ) 


( 101 ) 


The tangent hyperplane at x = 0 is given by q-x=0, 
where q is the unit vector whose scalar product 
with (100) identically removes the terms in 7 Q V , 

Ti V T n v _ 2 , (v = 1, 2 n-1). By (7) it is 

clear that q = b/ | |b | I as claimed in (8). Thus it 
is seen without further calculation that the 


O. = <f r — log(l + £ s l(s) ) ds , 

^ 2n VT |"|_p ,104a) 

CD 

|(s) £ (-l) n_1 e <P v ( T )s V . (104b) 

v=l 

Defining oij , (j = 1, 2, 3, . . . ) by 

03 

log (1 + e st(s)) t ^j^" 1 » (i05) 

j=l 

and proceeding as in Part IIC, the new para- 
metric form 


(-ir 1 £a i= Y e A + n-i + l (T) • (106a) 

A A 

UJl = Cpj (T) , 


1=0 


.n- 1 


v- 1 


W = $ (T) + — — ^ mil) cp ( T ) * 

V v m V-m 

m=l 


(V = 2, 3, 4, ... ) , a (106b) 

can be derived. The function £ is defined by 
solving (106a) for i = 2. 3, .... n [20] to get T i( 

(i = 0, 1, 2, . . . , n-2) as functions of o 2 o n 

and noting that iq are real and such that 
T 0 <T»<. . . <T _ 2 < 0. Since the cq are integrals 
for (i = 1, 2, . , n-1), they are unchanged by 

letting T n o 0. Now eliminate [20 ] the n-2 
parameters 7 Q < T l < » ■ • • » < T n-3 t> e ^ ween (n- 1) 
equations (106a), for i = 1, 2, . . . , n-1, obtaining 
Gy = 4 2 (ct 2 a ,) where *2 is an anal y tic 

function of fractional powers of its arguments. 
Clearly 0 o = ± (ai - $2> where the choice of + or 
- is unchanged by continuous variation of A or a. 
When A(s) = s n , as in (73)-(74) elementary argu- 
ments show that °o = 1 + * * * whence CT o = 

-(Oy - $ 2 ) in general. 
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Line 


5-8 

2 

Delete MATPWR, 

5-8 

11 

Add ", ELINV1(5, 5)" after ",TEMP(5)." 

5-10 

24 

Change "ELINV" to read "E LIN VI. " 

5-22 

22 

Change to read "IF(NEVN. EQ. 0)C0EFF(N+1)=1. 

5-22 

36 

Add "+PART 2" to end of line. 
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